ON  TIES  IN  TRIPLE  COMPARISONS 


By 

ROBERT  JOHN  BEAVER 


A  DISSERTATION  PRESENTED   TO  THE  GRADUATE    COUNCIL  OF 

THE    UNIVERSITY    OF    FLORIDA 

IN   PARTIAL    FULFILLMENT   OF    THE   REQUIREMENTS    FOR   THE 

DEGREE    OF  DOCTOR   OF  PHILOSOPHY 


UNIVERSITY  OF  FLORIDA 
1970 


THIS  DISSERTATION  IS  DEDICATED 

TO  MY  MOTHER,  WHO  STILL 

HAS  TROUBLE  PRONOUNCING 

"STATISTICS" 


ACKNOWLEDGMENTS 

I  wish  to  express  my  thanks  and  appreciation  to  Dr.  P.  V.  Rao, 
not  only  for  his  guidance  and  help  while  directing  this  dissertation, 
but  also  for  his  broad  smile  and  words  of  encouragement  at  times  when 
this  author  felt  overwhelmed  by  problems  yet  unsolved. 

I  would  like  to  thank  the  other  members  of  the  Department  of 
Statistics,  especially  Dr.  Frank  G.  Martin,  Dr.  William  Mendenhall 
and  Dr.  John  G.  Saw  for  their  advice  in  the  academic  realm,  as  well 
as  their  personal  efforts  on  my  behalf. 

I  would  also  like  to  thank  Mr.  Louis  Williams  of  the  University 
of  Florida  Computer  Center  for  the  use  of  his  progranmiing  talents  and 
Mi's.  Edna  Larrick,  who  has  transformed  a  crudely  written  manuscript 
into  a  masterpiece  of  t>TDing. 

I  would  be  remiss  if  I  did  not  express  belated  thanks  to 
Ml-.  Paul  Benson  of  Bucknell  University,  for  it  was  he  who  in  1964 
started  me  down  this  road  called  "statistics. 


ill 


TABLE    OF    CONTENTS 

Page 

ACKNO\VLEDG!\ffiNTS iii 

ABSTRACT vi 

CHAPTER 

1  INTRODUCTION   1 

2  THE  USE  OF  LIMIT  THEOREMS  IN  PAIRED  y-VNTi  TRIPLE 

COMPARISON  GENER.ALIZED  MODEL  BUILDING 4 

2.1  Introduction  4 

2.2  Background  for  Paireci  Comparisons 4 

2.3  Statistical  Interpretation  of  the  Stimulus- 

Respoiise  Plienomena '^ 

2.4  The  Use  of  Limit  Thcorenis  in  Paired  Coinparisors   .  .  8 

2.5  The  Asjnniftotic  Derivation  of  the  Generalized 

Br adl 03' -Terry  Model  for  Paired  Comparisons 12 

The  Exponential  Type  Distribution  12 

The  Cauchy  Type  Distribution IS 


The  Limited  Type  Distribution    

Estimation  of  the  Location  Parameter  in  the 


19 


23 


28 


Limited  Type  Distribution  

2.6  The  Use  of  Limit  Theorems  in  Triple  Comparisons 

2.7  The  Asymptotic  Derivation  of  the  Generalized 

Bradley -Terry  Model  for  Triple  Comparisons  32 

The  Cauchy  Type  Distribution 32 

The  Exponential  Type  Distribution  38 

The  Limited  Type  Distribution  ...  


41 


TABLE  OF  CONTENTS  (Continued) 

CHAPTER  Page 

2  (Continued) 

2.8   Comments  Regarding  Results  44 

3  GENERALIZ./\TICN  OF  THE  BRADLEY-PENDERGIUSS  MODEL 46 

3.1  Introduction 46 

3.2  The  Development  of  the  Generalized  Bradley- 
Pendergj-ass  Model  for  Triple  Comparisons    49 

4  ESTIM^^TION  AND  TESTS  USING  THE  GENERAJ.IZED  BRADLEY- 
PENDERGR-'iSS  MODEL 57 

4.1  :ilaximum  Likeliliood  Estimation 57 

4.2  Tests  of  Hypotheses 63 

4.3  Combination  of  Experiments  67 

5  LARGE  SAMPLE  PROPERTIES  OF  ESTIM(\TOHS  AND  TESTS 72 

5.1  Tlie  Limiting  Disti'i  button  of  the  Maximum 

Likelihood  Estimators   72 

5.2  An  Approximation  to  E  in  the  Case  of  Equal 

Treatment  Ratings   76 

5.3  A  Comparison  of  the  Powers  of  Tests 79 

5.4  Asymptotic  Relative  Efficiencies  91 

5.5  A  Nuraerical  Example 96 

BIBLIOGR-APHY 102 

BIOGRAPHICAI.  SKETCH 105 


Abstract  of  Dissertation  Presented  to  the 

Graduate  Council  of  the  University  of  Florida  in  Partial  Fulfillment 

of  the  Requirements  for  the  Degree  of  Doctor  of  Philosophj' 

ON  TIES  IN  TRIPLE  COMPARISONS 

By 

Robert  John  Beaver 

June,  1970 


ChairBian:   Dr.  P.  V.  Rao 
Major  Department:   Statistics 


This  study  is  concerned  with  the  development  of  triple 
coinpririson  models  that  account  for  ties  among  the  observations.   The 
generalized  Bradley -Terry  model  for  paired  comparisons  is  developed 
by  moans  of  the  extreme  value  distributions  of  Fisher  and  Tippett, 
Gnedenho  and  others  in  the  fi-amework  of  response-stimulus.   Using  the 
f raiuev/ork  developed,  a  generalized  Bi-adley -Terry  model  for  triple  com- 
parisons with  ties  is  developed.   Due  to  its  lack  of  syiimietry  and 
reversibilitj',  as  well  as  othei  undesirable  properties,  tliis  model  is 
abandoned  and  the  Bradley-Pendergrass  model  for  triple  comparisons  is 
generalized  so  as  to  account  for  ties  among  the  observations.   This 
generalization  is  accomplished  by  considering  a  triple  comparison  to 
be  tacitly  composed  of  tliree  independent  paired  comparisons.   Using  the 
generalized  Bradley -Terry  paired  comparison  model  for  the  paired  compar- 
ison probabiliti.es  and  conditioning  the  outcome  upon  the  event  that  no 
inconsistent  rankings  occur,  we  arrive  at  a  generalized  Bradley- 
Pci'i.dergrass  model. 


An  iterative  procedure  for  obtaining  the  maximum  likelihood 
estimates  of  tlie  parametei^s  introduced  into  the  model  is  given  and 
their  large  sample  properties  investigated.   Tests  of  the  parameters 
of  tlie  generalized  Bradley-Pendergrass  model  based  on  likelihood 
ratios  are  given.   The  power  of  the  likelihood  ratio  test  for  testing 
the  equality  of  treatment  ratings  is  found  and  compared  with  the  same 
test  using  the  Bradley-Pendergrass  united  model  as  v/ell  as  the  analysis 
of  variance  F  tests  for  balanced  complete  and  incomplete  block  designs. 
The  asymptotic  relative  efficiencies  of  the  likelihood  ratio  test  using 
the  generalized  Bradley-Pendergrass  model  to  the  other  three  afore- 
mentioned tests  are  also  given. 

The  study  incl\ides  a  numerical  example  demonstrating  the  use 
of  the  estimators  and  tests  developed  for  the  generalized  Bradley- 
Pendergrass  model. 


INTRODUCTION 

In  situations  where  quantitative  measurements  of  treatment 
effects  are  not  possible,  or  perhaps  not  practical,  methods  of  rank 
analysis  are  frequently  used  to  analj^ze  the  results  of  these  experi- 
ments.  Problems  of  sf-atistical  analysis  based  on  ranks  arise  in 
experimental  designs  pai-alleling  those  used  in  the  classical  analysis 
of  variance  approac}i.   Much  has  been  done  in  the  area  of  complete 
block  designs;  however,  in  tlie  area  of  balanced  incomplete  block 
designs,  witl:  the  exception  of  the  work  done  by  Durbin  [S],   rank 
analysis  techniqu3s  have  been  limited  to  the  cases  of  paired  and 
triple  comparisons. 

In  a  paired  or  triple  comparison  in  which  a  panel  of  judges 
ranks  two  or  three  treatments  at  a  time  on  the  basis  of  some  quality, 
a  judge  may  not  be  able  to  exTDress  a  real  preference  among  several  of 
the  treatments  to  be  judged.   The  inability  of  a  judge  to  state  a 
clear  and  decisive  preference  may  be  due  to  the  fact  that  his  sense 
of  perception  is  not  keen  enough  to  detect  tlie  existing  difference  or 
perhaps  due  to  the  fact  that  the  treatments  do  not  differ  in  the 
qualitj'  judged. 


Numbers  in  brackets  identify  references  in  the  bibliography. 


Most  models  postulated  do  not  allow  for  the  possibility  of 
a  judge  declaring  a  tie  between  two  or  among  three  treatments.   If  ties 
do  occur,  in  practice  they  have  been  (a)  completely  ignored,  (b)  equally 
divided  among  the  tied  members,  or  (c)  divided  randomly  among  the  tied 
members.   In  disregaring  ties,  however,  full  use  of  the  information 
contained  in  the  data  is  not  being  made. 

Glenn  and  David  [10]  have  proposed  a  modification  of  the 
Thurstone-Mosteller  model  for  paired  comparisons,  while  Rao  and  Kupper 
[21]  have  proposed  a  modification  of  the  Bradley-Terry  model  for  paired 
comparisons,  each  modification  making  provision  for  tied  observations. 
In  this  paper  we  generalize  the  Bradley-Terry  [4]  and  the  Bradley- 
Pendergrass  [20]  models  for  triple  comparisons  so  as  to  make  provision 
for  ties. 

In  Chapter  2  generalized  Bradley -Terry  models  for  paired  and 
triple  com.parisons  are  derived,  using  limit  theorems.   The  paired  com- 
parison experiment  is  put  into  the  fra:nework  of  the  stimulus-response 
phenomena  and,  following  the  approach  of  Thompson  and  Singh  [24],  the 
generalized  Bradley-Terry  model  for  paired  comparisons  is  derived,  using 
the  limit  theorems  developed  by  Fisher  and  Tippett  [9],  Gnedenko  [11], 
and  others.   Using  this  sajne  framework,  a  generalized  Bradl  ey-Teri-y 
model  for  triple  comparisons  is  developed. 

Since  the  generalized  Bradley -Terry  model  derived  using  limit 
theorems  lacks  the  properties  of  syminetry  and  reversibility,  as  well 
as  being  unwieldy  in  form,  in  Chapter  3  the  Bradley -Pendergrass  model 
for  triple  comparisons  is  generalized  to  account  for  the  occurrence 


of  ties.   Since  this  model  overcomes  the  objections  to  the  generalized 
Bradley -Terry  model,  it  is  further  explored. 

In  Chapter  4  the  parameters  underlying  the  generalized  Bradley- 
Pendergrass  model  are  estimated,  using  the  method  of  maximum  likelihood; 
in  addition,  likelihood  ratio  tests  of  these  parameters  are  presented. 

The  case  of  n  replicates  of  the  total  experiment,  as  v/ell  as 
the  case  of  g  groups  of  replic  tes  with  n   replicates  in  the  u   group 
(u  =  l,2,...,g),  is  considered. 

Large  sample  properties  of  the  estimates  and  tests  proposed 
in  Chapter  4  are  given  in  Chapter  5.   The  limiting  distribution  of  the 
estimators  is  develo])ed;  the  powei"  of  the  likelihood  ratio  test  of 
equality  of  treatment  ratings  for  the  generalized  Bradley -Pendergrass 
model  for  ti-ii^le  comparisons  is  compared  to  that  for  the  Bradley- 
Pendergrass  model  and  tlie  analysis  of  variance  F  tests  for  balanced 
complete  and  incomplete  block  designs.   The  asymptotic  relative  effi- 
ciency of  the  likelihood  ratio  test,  using  the  generalized  Bradley- 
Pende}'grass  model,  to  the  other  three  tests  just  mentioned  are  also 
given. 

A  numerical  example  demonstrating  the  use  of  the  estimates  and 
tests  developed  for  the  generalized  Bradley -Pendergrass  model  is  given 
in  Chapter  5. 


CHAPTER  2 


THE  USE  or  LIMIT  THEOREMS  IN  PAIRED  AND  TRIPLE 
COMPARISON  GENERiVLIZED  r>;ODEL  BUILDING 


2.1   1 nt  rodu  c  t  i  on 

The  pai:'ecl  and  triple  comparison  experimental  arrangements  are 
common  in  the  behavioral  sciences.   In  a  paired  comparison  expei'iment, 
a  subject  is  ex-posed  to  two  stimuli  and  is  asked  to  report  the  greater 
of  the  two  stimuli  he  ex-periences.   In  a  triple  comparison,  on  the  other 
hand,  thc^  subject  is  exposed  to  tliree  stinuli  and  is  asked  to  report  the 
relative  i;i2f;ni tudo  of  the  resulting  oxioorienccd  sensations.   Most  exist- 
ing models  do  not  allow  for  the  occurrence  of  ties  in  the  ranking  of 
the  stimuli  by  a  subject.   In  this  chapter  we  shall  consider  probabil- 
istic models  dorivod  using  limit  theorems  for  both  paired  and  ti-iple 
comparisons  whicli  allow  for  ties  betv/een  two  or  among  three  stimuli  if 
the  sensations  evoked  bj'  these  stimuli  are  nondistingui  shable  to  the 
subject. 


2.2   Background  for  Paired  Compai'isons 


that  a  subject  reports  stimulus  X 


comparison  exiTeriment,   Thurstone  [25]  advanced  the  law  of  comparative 


of  stimuli,  X   and  X  ,  were  assumed  normal  and  independent  with  means 

2 

y,  and  |i  and  common  variance  0'  ,  Mosteller  [16]  noted  that  the  assump- 
tion of  independence  was  not  essential  and  could  be  relaxed  to  the  condi- 
tion of  equal  correlations  for  all  pairs  of  stimuli.  Their  model  may  be 
suimnarized  by  writing 

P[X  -X  ]  :.  (2n)-^/2  J  exp   -  |  t^  dt.  (2.2.1) 


Bradley  and  Terry  [3]  proposed  an  alternative  to  the  law  of  comparative 
judgments,  postulating  that 

CO 

Pt^"'^..!  =  j/  ^^""^'^    4^  '^^'  (2.2.2) 

'^   -(In  11^ -In  n^) 

where  (In  n  -In  1":  )  could  be  regarded  as  a  location  parameter  for  the 
variate  (y   -  y  ).   Glenn  and  David  [10]  have  proposed  a  m.odif ication 
of  the  Thurstonc-Mosteller  model  that  makes  provision  for  a  tie  between 
two  stimuli  by  replacing  the  normal  distribution  of  the  Thurstone- 
Mosteller  model  by  an  "angular"  distribution,  postulating  that  a  subject 
will  declare  a  tie  when  the  difference  between  the  two  responses  lies 
below  a  certain  threshold.   Essentially,  Glenn  and  David  postulate  the 
existence  of  a  parameter  T  and  an  interval  of  length  2T  around  the 
true  mean  value  of  the  difference  in  exioerienced  sensation,  S-^-S^,  such 
that 


p[x^-x2]  =  Pfy^-yg  ^  ^1' 

P[X^  =  X2]  -  P[|  y-^-Yg  !  '^   ^] 


P[X2'*x^]  ==  Piy^-Yg  <  -^:i. 


(2.2,3) 


F^Ca)  =  (2n)  ^/^  J  ^^  -  I  *^  ^*-  (2.2,4) 


-a-CS^-S^) 


Hence) befoi-e  being  manipulated  and  transformed,  the  Glenn-David 
probabilities  correspond  to 


PCX^^X^]  =  F(T)  -  F(-T),  (2,2.5) 


Rao  and  Kupper  [21]  have  proposed  a  generalization  of  tlie  Bradley-Terry 
model,  using  an  approach  similar  to  that  of  Glenn  and  David,   They 
introduce  a  tlireshold  parameter  into  the  Bradley-Terry  model  to  account 
for  ties,  showing  that 


-iv^-v^)+T\  1    2 


^f^2''\^  =  \s       -ch^|)  dt  =  j:2  ^2_2_^^ 


exiD  Tl      and     n.    =    exjD   v.   ,  i  =    1,2. 


Thompson  and  Singh  [24]  have  shown  by  the  use  of  limit  theorems  that  the 
Thurstone-Mosteller  model  arises  quite  naturally  when  experienced  sensa- 
tion is  either  the  sum  or  some  quantile  of  a  large  number  of  responses, 
while  the  Bradley-Terry  model  arises  when  experienced  sensation  is  the 
maximum  of  a  large  number  of  responses. 


2.3   Statistical  Interpretation  of  the 
Stimulus -Response  Phenomena 


In  order  to  present  anotlier  way  in  which  the  Rao-Kupper  general- 
ization of  the  Bradley-Terry  model  can  arise,  let  us  review  the  psycho- 
logical framework  proposed  by  Thompson  and  Singh  [24].   Sensory  perception 
begins  with  the  activation  of  a  subject's  receptors  by  a  stimulus. 
A  large  number  of  signals  are  then  transmitted  from  individual  receptors 
to  the  brain  where  they  are  synthesized  into  an  overall  intensity  of 
the  stimulus.   Intensity  of  a  given  stimulus  is  thought  to  depend  upon 
the  number  of  receptors  activated  and  the  frequency  of  neural  activity 
within  each  receptor.   To  account  for  the  fact  that  a  subject  reports 
the  more  intense  stimulus  as  the  lesser  stimulus,  a  random  error  in  the 
transmission  system  is  postulated.   This  random  error  appears  as  the 
relative  frequency  with  which  a  subject  reports  stimulus  X^  as  greater 
than  stimulus  X  .   This  relative  frequency  approximates  VIX^-'X^']. 
We  shall  assume  that  a  subject  receiving  stimulus  X  exi^eriences  a  sen- 
sation y,  where  y  is  real -valued  and  subject  to  chance,  and  that  the 
experienced  sensations  y   and  y   corresponding  to  stimuli  X^  and  X^ 
satisfy 

^1 
P[X^  -X  ]  =  P[-->  C] 

^2 


for  C  a  real  number.   The  sensation  parameter,  denoted  by  Y,  is  defined 
as  the  mode  of  the  distribution  of  experienced  sensation,  y. 


2.4   The  Use  of  Limit  Theorems 


in  Paired  Comparisons 


,  u   denote  signals  transmitted  to  the  brain 
m 

by  m  sense  receptors  in  response  to  stimulus  X,  where  m  is  largo,  but 

fixed.   The  individual  signals  are  considered  to  be  random  variables 

which,  when  combined  psj-chophysically,  form  the  experienced  sensation 

V  .   V/e  shall  assume  that  there  exist  sequences  of  constants,  f  1-l' ] 
•'m  m 

and  [ct' }  with  n'  >  0,  and  a  distribution  function  H(y)  such  that 


H(y). 


Stevens  [22]  reports  that  there  may  be  two  basic  mechanisms  of  discrim- 
ination:  (1)  an  increase  in  intensity  of  a  stimulus  results  when  neural 
excitation  is  added  to  excitation  already  present,  whereas  (2)  a  change 
in  the  quality  of  a  stimulus  results  when  there  is  a  change  in  the  dis- 
tribution of  excitation,  i.e.,  when  new  excitation  is  substituted  for 
old.   This  suggests  two  of  the  three  models  considered  by  Thompson  and 
Singh. 

1.   E>rperienced  sensation,  y,  is  the  sum  (or  average)  of  a 

large  number  of  signals  transmitted  by  individual 

receptors. 


2,  Experienced  sensation,  y,  is  the  median  or  some  quantile 
of  a  large  number  of  transmitted  signals. 

3,  Experienced  sensation,  y,  is  the  maximum  of  a  large 
number  of  transmitted  signals. 

Models  1  and  2  lead  to  asymptotic  normal  distributions  for  experienced 
sensation,  while  model  3  leads  to  the  extreme  value  distributions 
developed  by  Fisher  and  Tippett  [9],  Mises  [15],  Gnedenko  [11], 
Gumbel  [12]  and  others.   Their  research  is  suimnarized  in  the  following 
theorem. 

Theorem  2.4.1. 


a   conmion   distribution   function  F.       If,  for  y     =   max    [u,  ,u,^, .  .  .  ,u    ], 

•^m  1 '    2'         '    m-^  ' 

there   exist    sequences   of    constants,  [\x' ]    and    fo'},    0"'    >  0,  sucli   tliat 


lim     P 


y~K 


-   H(y)  (2.4.1) 


exists  and  is  a  non-degenerate  distribution  function,  then 

H(y)  =  Y.(ay+b),  a  >  0  for  one  of  the  three  following  functions: 
Y^(y)  =  exp  (-e~^)    ,  _  c  <  y  <  co 

,0  y  S  0 


V3(y)  .  { 


exp  (-y   )  y  >  0 


exp  -  (-y)  y  <  0 


Q'  >  0 


(Proof  is  omitted.  ) 


Thus,  if  y  has  a  non-degenerate  limiting  distribution,  we  may  writt 
approximately  for  large  m, 


PLy^Sy]  P.Y^ 


y-M'„ 


(2.4.3) 


where  0  =  O'/a,  u  =  ll'  -  ba'/a   and  Y  (y)  one  of  the  three  functions 
m    m     m    m     ra         i 

of  theorem  2.4.1.   The  initial  distribution  function,  F,  is  said  to  be 

of  exponential,  Caucliy,  or  limited  type  according  as  the  limit  distri- 

Ls  ,^,    v^  or  V3. 

Thompson  and  Singh  [24]  interpret  the  parameters  li  and  0   in 

m      m 

terms  of  the  limiting  di  stribi'tion.   Y,  [  Cj'-U  ) /O   ]  has  mode  |.i  ,  while 

1mm  HI 

a      is   a   scale  parameter.      For   an    initial    distribution  of    the   Cauch}' 
type,    [i     =-   0   for   all   m;    hence   the   limit   will    be   of    the  form  Y    (y/a    ;0) 

1/0! 

which  has  mode  O    (ft'/C+l)    .   If  F  is  of  the  limited  type,  tliere  exists 

a  finite  number  jj,  such  that  F(a:)  =  1,  but  for  each  e  >  0,  F(tu-e)  <  1; 

thus  LL  =  a  for  all  m.   The  mode  of  Y^[(y-uj)/a  ]  is  uj  for  0  <  »  S  1 
m  J        m 

1/0! 

and  ai  -  C  [(Q'-l)/C^]     for  &  >   1. 
m 

The  following  theorem  will  be  useful  in  investigating  the  limit 
distributions. 

Theorem  2. 4. 2. 


distribution  of  the  random  variables 


P'  -2 2   2   1/2 -^  " 


.^  -  p  X  Z^ 


,^   2,2,1/2 

(1+p  X  ) 


Proof  of  theorem  2.4.2.   Write 


.2      2   2  ,1/2 
Im       2n 


/,    2  ^2n\l/2       ^    ^Im   V. 


P   ^. 


-t  9   (t,  ,t„)  be  the  joint  characteristic  function  of  the  standardized 
mn   1   2 


random  variables 


^im  -  ^im    ,!2njJV 
— — and  


cp   (t  ,t  )  converges  imiformly  to  ^(t  ,t  ),  the  joint  characteristic 
mn   12  12 

function  of  Y-,  and  Y„.   Therefore  the  joint  characteristic  function  of 


,  2       2    -1/2 
Im   ^       2n 


f.       r.    2  ^2n  1  -^/2        r    O^,   -|  -1/2 


converges  unifoi'm.ly  to 


<p(t^tl.pV]-^'-^-t^[l.p-v^l-'^^; 


which  is  the  characteristic  function  of  the  random  variable 


2   2  1  /2 


Hence,  the  theorem  is  proved. 

In  the  investigation  of  models  1  and  2  for  the  untied  case, 

Thompson  and  Singh  arrived  at  the  Thurstone-Uosteller  model,  while 

model  3  led  to  the  Bradley-Terry  model.   We  restrict  our  attention  to 

model  3,  where  exi^erienced  sensation,  y  ,  is  the  maximum  of  the  m 

m 

sienals  (u  ,  u  ,  ...,  u  ),  and  derive  the  generalized  Bradley-Terry 
12        m 

model  for  paired  comparisons  as  given  by  Rao  and  Kupper  [21]. 


2.5   The  Asymptotic  Derivation  of  the 
Generalized  Bradley-Terrj'  ?.Iodel  for 
Paired  Comparisons 


The  Ex]3on&ntiol  Type  Distribution 

Let  V   be  the  e>qDerienced  sensation  defined  as 
Im 

max  (u  ,  u  ,  ..,,  u  ),  where  [u,  ,  u  ,  ...  }  is  a  sequence  of  independent 
identically  distributed  random  variables  with  common  distribution  func- 
tion F,  while  y   =  max  (v   v  ,  ...,  v  )  where  [v  ,  v  ,  ...  }  is  a 
sequence  of  independent  identically  distributed  random  variables  with 
common  distribution  function  G. 
In  the  comparison  of  tv 
nential  type  distributions,  we  postulate  the  existence  of  a  parameter  ,1]^ 
whereby  a  subject  will  report 


13 


and 


'<l-'=<2 

if 

^1..  -   y2n  >  ^ 

h'-h 

if 

1^1.   -   ^2n'    < 

"s-^ 

if 

^m   -   >'2n  <   - 

(2.5.1) 


Tl. 


Hence  T|  is  a  threshold  parameter,  since  the  subject  reports  no  differ- 
ence between  stirauli  X  and  X  imless  the  difference  between  the  expe- 
rienced sensations  exceeds  T|  in  absolute  va]  ue. 

Now  there  exist  sequences  of  constants,  f (u.  ,0.  )}   (i=l,2), 


Y, (y)  =  exp  (-e  ^) 


<  y  <co. 


(2.5.2) 


If  m  and  n  tend  to  ^o  such  that  O^   /o^      ->  X ,    it  is  easily  shown  that 

2n   Im 


^yim-^-2n^  -  ^^lm-^2n^  , 

(of   .^')'/' 
Im    2n 


J  exp  -  [wt'^  +  t]  d1 


(2.5.3) 


2  1/2 

with  w  =  exp  {-z(l+X  )    }  which  for  X   =^    1    simplifies  to 


[1  +  exp  (v^z)] 


(2.5.4) 
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Now  consider  P[X  -  X],  which  is  given  as 


Im    2n 


^  Im  2n'^    -i 

(2.5.5) 


For  large  values  of  m  and  n  with  X  =  1,  we  can  write 


n  -  (K.-Ho.; 


'-  Im"^  2n^ 


(2.5.6) 


so  that  for  0  =  exp  J2   T1/(ct  +a   )      and  n^  and  v      satisfying  the 
'   Im   2n  1       2 

equation 


log 


\'         [l(a2  ,c:2    1/2 
^2   Im   2n'^-' 


(2.5.7) 


we  get  from  (2.5.5) 


^'^\^^2.   >  ^^  -  ^ 


^  -  On^ 


P[X,-X„]  ~ 


1   2      TT   +  GlT 


(2.5.8) 


In  a  similar  manner,  we  can  show  that  for  large  m  and  n, 


P[X^-X  1  « 


^2     1^-TT^.  e.T^ 


PfX,  =X^] 


lYT^(e'^-i) 


(2.5.9) 
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Eqiiations  (2.5.2)  imply  that  asymptotically,  y^^  and  y^^  have 
distribution  functions 

Im  2n 


R'hich  have  modes  \i        and  u   ,  respectively.   Therefore,  for  this  model, 
Im      <in 

was  defined  to  be  u   ,  the  mode 


y  ,  the  sensation  due  to  stimulus  X  , 


Im' 


of  y   .   Similarly,  Y  ,  the  sensation  due  to  X^,  is  given  as  n^^. 


4^  Im    2n^-' 


in  equation  (2.5.7),  we  obtain 


log  ^— ;  =  — ^ 


(2.5.10) 


which  says 


rr.  =  k  exp  - 


1,2. 


Hence, for  initial  exponential  type  distributions,  with  X  =  1,  we  have 
obtained  the  generalized  Bradley-Terry  model: 


PLX^-Xg]  «ll  + 


(^'l  -  ^2^ 


(2.5.11) 


Equation  (2.5.11)  provides  a  psychological  interpretation  of  the  general- 
ized Bradley-Terry  model  in  terms  of  the  sensation  parameters,  Y^  and  Y^. 


The  assumption  that  \   =  1  implies  that  the  experienced  sensations 
have  asymptotically  equal  dispersions  but  different  modal  values. 

The  Cauchy  Type  Distribution 

As  for  the  exponential  type  distribution,  we  assume  that 

V   and  V    are  each  the  maximum  of  a  set  of  m  and  n  independent, 

^Im     ■^2n 

identically  distributed  random  variables  having  distribution  functions 

F  and  G,  respectively;  however,  we  now  consider  F  and  G  to  be  Cauchy 

type  distributions.   For  two  Cauchy  type  distributions  the  sequences 

fu  1   (i==l  2)  can  be  taken  to  be  sequences  of  zeros.   Therefore, 
•^  ■  im-^       ' 

there  exist  sequences,  fa^^^}  and  [c-^ J,  such  that 


and 


lim  P 


lim  P 

j^  -ICO 


'im  -   ' 


-  im 


2n 


exp  -y 


0         y  S  0   «.  >  0    (i=l,2) 


2  '  '  1     •>  --^   --^i    y  >  0  (2.5.12) 


Since  the  measures  of  central  tendency  are  known,  we  propose  that,  as 
in  the  case  of  known  means,  that  the  ratio  of  the  ex-perienced  sensa- 
tions y   and  y   be  investigated.   We  postulate  the  existence  of 
Im      2n 

a  threshold  parameter,  T|,  whereby  a  subject  reports 


^1-^2 

if 

^1    =    ^2 

if 

^2-*^! 

if 

log  y^^^  -  log  y^^^  >  n 


log  y^^^  -  log  yj    <  D 


log  y^^^  -  log  y^^  <  -Tl  . 


(2.5.13) 


P[log  y^^  -  log  y^^  <  -T]]  .  P[y,/y2„  <  e"^] 


.-^1 


(2.5.14) 


-T] 
'im    ®    ^2n 


,   2    -2T1  2  ^1/2 
(g  +e   'a  ) 
Im      2n 


From  theorem  2.4.2,  with  p  = 
"^im  -  y2n 


-"H 


lim   P 
m,n  -"» 


,  2     2    ,1/2 
(a  +p  o-  ) 
Im      2n 


-f     Y^  ["pXt  .  z(l  +pV)'/2 


2,2-,l/2 

2[1  +p   X  ] 

pX 


d  Y^^,  (t),   (2.5.15) 


2  2  1/2 
whicli  for   w  =  z(l  +  p  X  )      becomes 


pX 


J     exp  -  [ ( w  +  p  Xu     )     +  u]  du 


(2.5.16) 


simplifies,  giving 


lim   P 

m,n  -"» 


,2         2  2  ^1/2 


fv  -a 

=  j  exp  -  u  [(Xp )    +  1]  du 


(2.5.17) 


1  +  (^p) 

As  an  approximation  when  m  and  n  are  large,  one  can  write 

cr 

and  hence 


1  +  p 


^o„  +  P     0-, 


(2.5.18) 


Now  for  TT,  cc  cj   ,   TT   o:  c     and   6  «:  p 
1     Im'    2     2n  ^ 

generalized  Br adlej- -Terry  model  given  as 


we  have  the  form  of  the 


P[X„-X  ]  ^ 


2    1     Tt, 


(2.5.19) 


From  (2.5.18)  and  the  definition  of  true  sensation  as  the  mode  of  y, 
we   have 


\   -   ^im  fe)      --^  ^2  =  "'2n  W^ 


(2.5,20) 
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which   yields 


PCx^-x^l  = 


(2.5.21) 


It  is  easily  shown  that 


P[X,  -X„]  ^ 


'l      "2^  ^  n^  +  6iT, 


P[X,  =  X^] 


.^n^(B^_l) 


\  -  "2^  ~  (H-reiryoT-TBiT)  • 


The  Limited  Type  Distribution 

Suppose  5',   and  y    are  each  the  maximum  of  a  set  of  independent, 
identically  distributed  random  variables  having  distribution  functions 
F  and  G,  respectively,  where  F  and  G  are  limited  type  distributions. 
Then  there  exist  real  numbers,  a'  ,  tJJ  ,  and  sequences,  [o   },  [a^    }, 
such  that 

Plm  -  '^'l  , 


lim  P 
m- 


YgCy;^',) 


and 


lim  P 


for 


YgCyjO'.)  =  { 


exp  -  (-y) 


y  S  0 


y  >  0 


CV.  >  0    (i=l,2).    (2.5.22) 


When  comparing  two  random  variables  with  known  measures  of 

central  tendency  and  unknown  measures  of  dispersion,  it  is  natural  to 

compare  the  ratio  of  the  random  variables,  each  corrected  for  its 

measure  of  central  tendency.   Althougli  the  quantities  uj   and  a'   will 

be  unknov.Ti  in  practice,  we  propose  to  show  later  in  this  chapter  that 

no  changes  in  methodology  will  be  encountei^ed  if  one  has  consistent 

estimates  of  a!   and  oj  .   Hence  we  now  proceed,  assuming  oj   and  uj 
12  X  z 

kno\m,  to  investigate  the  ratio  (y  '^■'^^^yn   ~^2^' 

VVe  postulate  the  existence  of  a  threshold  parameter,  T|,  whereby 

the  subject  will  report 

if  (yi„r^^i)/(y2n-^2)  <  ^"'^  ' 

if      e-^  <  (y,,--,)/(y2n-2>  <  ^"^ 

^>'lm-l^/^^2n-2>   ^   ^"^        ' 

Recall    that   y        and  y        are   limited    to   the   right   by  ou,    and  cjj^,    respec- 
■ Im  "  2n  12 

tively,    and   therefore    (y      -uj    )    and    (y      -uj    )    are  both   negative   quantities. 
Now  consider 

I   (y     -^  )  y. 

PCX    -XI    =    p!        liH-l      <e-^ 
1       2  j   (y^„-oj^) 


^--^2 

^1  = 

=  ^2 

^2-^^ 

P^(y,„-<^.)    >    e"^    ^y2n^2^J 


Im     1' 


H_^^lm-^"'^   W    -    ^-"""^  V    ^   °j        '  ^2.5.23) 


which  for  p  =  e    can  be  written 


,2         2  2  -1/2 
Im  ^   2n 


<  0 


(2.5.24) 


2    2    1/2  -T| 

By    theorem   2.4.2,    witli   w  =    z(l   +  p    X    )  and     p    =    e      ,    it    can 

be   deduced   that 


^yim-py2n^-^'"rP^2^ 


,2         2    2    ,1/2 

Im  ^       2n 


'  Xp 


J        dV    (t;cv) 


(2.5.25) 


Ap 
The   right-hand    side   of    (2.5.25)    can  be  written    as 


/        c    (-1)  exp 


r  "*1  ""21 

{[-(pXt+w)]         +    (-t)    ^) 


-  /  %(-t)    ^        exp    [-(-t)    ^]    dt, 


(2.  5. 26) 


pX 


Wlicn   z   =    0      and      »     =    CV      =    CV   in    (2.5.26),    we   obtain 


P[X^-X^]   -^ 


1  +  p   X 


(2.  5. 27) 
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For  large  values  of  m  and  n,  writing   a  /o       «  \   we  get 


Of 

1 

c./^2nN 
Im 

-a     -a 
P         ^2n 

-Q'  -ft    -a 

P    Q^r>   +  Cr, 


^2n 


(2.5. 28) 


For  11  "^  a~    ,   If   °^  e~    and   6  oc  p   ^  (2.5.28)  is  in  the  form  of  the 
1     Im     2     2n 

Rao-Kupper  generalization  of  the  Bradley-Terry  model. 

For  0  <  Ck-  <  1 ,  we  have  no  psychological  interpretation  of  the 
model  in  terms  of  parameters,  but  for  cv  S:  l , 

I/O' 

l/a 
^2  =  ^  -  ^2n^^-^/"'>     • 

Therefore, in  terms  of  sensation  parameters,  we  can  write 

-1 


-"^2-^2--^^ 


P[X^-.X^]..i^l.  e  Q-^)        I     .  (2.5.29) 


In  a  manner  similar  to  that  for  the  exponential  and  Cauchy  type 
distributions,  we  find 

P[X„-XJ 


and 


2    1   ^  ^2  ""    1 


n^n^O^-l) 
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Estimation  of  the  Location  Parameter 
in  the  Limited  Type  Distribution 

In  tlie  development  of  the  generalized  Bradley-Terry  model  for 


practice  these  quantities  would  rarely  be  ];no\\Ti;  hence  estimates  of 
these  parameters  are  required.   No  change  in  preceding  methodology  is 
required  if  a  consistent  estimator  for  uj  is  available. 

It  is  easily  verified  that  the  mode  of  Y  [(y-<D)/cr  ]  is  o)  if 

0  <  a  s  1   and  oj  -  a  (a-l/a)     if  a  >   1.   The  sequence  [a  ]  has  the 

-l/cy 
property  tliat   a  >  0,   a  >-  a      ^       and  is  of  order  n      (sec,  for 
'   '    •'        n        n    n+1 

example,  Gumbel  [12]  or  Gnedenko  [11]).   Hence,  asymptotically,  the 
mode  of  the  limiting  distribution  is  oj  for  o  >  0. 

It  is  reasonable  to  assume  that  a  subject  is  able  to  arrive  at 
an  empirical  estimate  of  w.  In  fact,  Parzen  [IS]  has  given  a  class  of 
estimators  for  the  mode  and  density  function  corresponding  to  a  given 
distribution   function   which  are  consistent  under  certain  I'egularity 
conditions.   Venter  [26]  also  gives  tvs'o  consistent  estimators  of  the 
mode  of  a  density  function  which  are  appealing.   For  an  ordered  sample, 
(Y  ,  Y  ,..,,Y  ),  tlie  mode  is  estimated  by  the  suitable  points  in 
the  interval  formed  by  the  first  and  last  of  those   s   consecutive  Y^ ' s 
which  are  closest  together.   The  mathematics  of  these  estimators  is 
omitted  and  the  reader  referred  to  the  two  articles,  as  well  as  that 
by  Chernoff  [6],  for  further  details.   It  is  sufficient  here  to  note 
that  consistent  estimators  of  the  mode  of  a  distribution  exist. 


When  using  a  consistent  estimator  of  the  mode,  the  distribution 
of  (y-'jj  )/CT   is  asymptotically  the  same  as  that  of  (y-a))/a   as  shown 
by  theorem  2. 5. 1. 


Theorem  2. 5. 1. 

Let  F   denote  the  distribution  fiinction  of  the  random  variable 
n 

(y-oi  )/a   and  Y  denote  the  limiting  distribution  fimction  of  (y-'ju)/Cf  . 
n   n  n 

If  uj   is  a  consistent  estimator  of  ul',  then  F   converges  to  Y  in 
n  n 

distribution. 

Proof  of  theorem  2.5.1. 


F  (z)  =    P 


Hn,   ^ 


a  o 

-  n     n 


1-   n         n  -I 


y-uj 
o 


UJ  -a'     UJ  -UJ 
z  -I  ,    I    <  e  \ 


L^n 


UJ  -CJU       UJ  -UJ 

n        n 


(2.5.30) 


y-cu  ^  n  I      n 


S,    =      =^— =^  S    z    + 
la  o 

n  n 


[y:^  ^  z  +  -iL-  ,   I  -i^  I  <  e  1 

a  o        '    ^      (J        ' 

1-     n  n  n 

r        0)    -UJ  -I 

[^    I    -^   I    ^    e   J      .  (2.5.31) 


For  UU      a   consistent    estimator   of  ai,    we  have 

n 

lim     P[    I    a      -  oj    I    <   e]    =    1        for   every      e  >  0    .  (2.5.32) 

n-*  <^^ 

-l/o" 
Notin"-  that   o   is  of  order  n     for  a   a  parameter  in  the  initial 
n 

distribution,  we  write  a   as  (en)    '  for   c  >  0;  hence,  for 

a 
c'  =  c  we  have 


P  I  I  a,^  -a;  I  <  -y^  1  •         (2.5.33) 


I /a 
Since    (2.5.32)    is    true   for    all      e  >  0,    take    e'    =    e/c'n        .      Then 


.im     P  r    I    -^    I    <   e  I  =      lim     P  r    I    c^j^   -  UJ    I    <   £'   I 


1.  (2.5.34) 


Therefore,  the  random  variable  (ci  -^w)/^   converges  to  zero  in  probabil- 
'  n     n 

ity,  which  is  to  say,  PES^l  -"  0.   However,  S^  is  a  subset  of  S^  and. 


ai   -cju 


(2.5.35) 


I  y-x 

U        n 


n 
I-      n 


(Ju   -O)  I 

n  -1 


y-(ju 

o 
n 


Therefore, 


lin,     P  [yiiili  r.    z    - 
n  -•i»        I-      n 


(2.5.3G) 


In   like  mramer. 


(JU    -<u 


(2.5.37) 


From    (2.5.35),     (2.5.36)    and    (2.5.37),  we   find 


-    e     £   lim 


n  -J 


(2.5.38) 


Since  (2.5.38)  is  true  for  all  e  >  0,  we  can  write 
Y(z)  S  lim  F  (z)  S  Y(z) 


(2.5.39) 


Hence,    we  have   shown   that   the  random  variable    (y-uj    ) /<S     has    the   same 

n        n 

asymptotic  distribution  as  (y-aj)P  ;  therefore,  the  theorem  is  proved. 

Writing  Z  =  (y-^  )/a   and  Z  -    (y-iu)/e  ,  we  have  showi  that 
n       n   n      n  n 

if  Z   converges  to  the  limit  random  variable  Z,  then  Z   also  converges 
to  Z.   Mann  and  Wald  [14]  in  theorem  5  of  their  paper  state  that  if 
X  converges  in  distribution  to  X,  and  g(x)  is  a  Borel  measurable  func- 
tion with  the  set  of  discontinuity  points  of  g(x)  closed  and  of 

measure  zero,  then  g(X  )  converges  to  g(X)  in  distribution.   If  we 
— n  — 

define 

g(z^,  V  = ^  , 


1      ^    z. 


wliere   Z'    is    the   limiting   random  variable   defined  by 


Yo   -  «Jr 


exist,  a  subject  can  base  his  decision  on  either  the  random  variable 
(y  -co  )/(y  -cu  )  or  the  random  variable  (Y,  "  "5  )/(y2  "  (JJg^  Vr'hen  the 
number  of  signals  resulting  from  each  stimulus  is  large. 
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2.6.   The  Use  of  Limit  Theorems 
in  Triple  Comparisons 

In  a  preliminary  report  concerning  the  rank  analysis  of  triple 
comparison  data  involving  t  treatments  or  items,  Bradley  and  Terry  [4] 
proposed  a  mathematical  model  by  postulating  the  existence  of  parameters, 
n  ,  TT  ,  ...,  TT  ,  satisfying  the  conditions  it.  SO  (i  =  l,2,...,t), 

t 

Z     T7.    =    1,    where   the  probability   that    treatment    i    is   preferred   to  j    and 
i==l      ^ 
k    and   treatment   j    is   preferred   to  k   is   given    as 

1      J      k        J      k 
Bradley    [2]    points   out    that    this   model    is    consistent   with    that   proposed 
by   Lelnuann    [13]    under   the    simplifying    assumption   that    the   random  var- 
iables,   say   V    ,    y.    and   y    ,    are   independent   with    distribution   functions 
F.  ,    F.    and  F    ,    respectively.      Then 

P[i    -   j    -    k]    =      J  /  J         CIF    (y    )     dF     (y    )     clF    ( y    ) 

V  >v   >y  -^      ^ 

^i    ^j    ^k 


i      j 


(n.+TT.+n   )  (ri.+iT  ) 
1      J      k        J      k 


(2.6.2) 


wliere  ".  ,    11.    and  n,     are  parameters   of    the   distributions,    F    ,    F      and  F    . 
1        J  k  '  '      i'      J  k 

Bradley  and  Pendergrass  [20]  considered  the  model  given  in 
(2.6.1)  and  (2.6.2),  but  for  reasons  of  synmietry  and  reversibility 
preferred   to  work  with   model    given   as 


P[i-'j-k]=-^ 2-^— J ,  (2.6.3) 

n.(TT.+Tr,  )    +  TT.(n.+n,  )    +  n    (n.+rr.) 
ijk  jik  kij 


The  generalization  of  the  model  given  in  (2.6.3)  to  account  for  ties 
in  the  data  is  developed  in  Chapter  3.   In  the  remainder  of  this 
chapter,  we  shall  investigate  the  generalization  of  the  model  given 
in  (2.6.1)  and  (2.6.2)  to  account  for  the  presence  of  ties  in  the  data. 
As  noted  in  Section  2.5,  when  considering  a  model  in  the  psychological 
context  of  stimulus  and  sensation,  the  generalized  Bradley-Terry  model 
resulted  when  experienced  sensation  was  taken  to  be  tlie  maximum  of  tlie 
signals  sent  by  m  sense  i-eceptors.   For  this  reason,  we  too   shall  take 
experienced  sensation  to  be  the  maximum  signal.   We  shall  vise  the  same 
definitions  and  assumptions  given  in  Sections  2,3  and  2.4  witli  obvious 
extensions  to  account  for  three  stimuli  and  three  sensations  considered 
s  i  r.i  ul  t  an  eou  s  1  y . 

In  ranking  the  stimuli  X.,  X.  and  X  ,  we  assume  that  a  subject 
arrives  at  his  total  ranking  by  comparing  the  three  combinations  (i,j), 
(i,k)  and  (j,k)  in  the  form  of  ratios  or  differences.   In  general,  to 
arrive  at  an  untied  ranking  that  is  consistent,  it  is  sufficient  to 
know  the  outcomes  in  the  ranking  of  two  properly  chosen  pairs. 
For  this  reason,  the  following  t teorem  will  be  of  value  in  evaluating 
required  probabilities. 

Theorem  2.6. 1. 


If  the  joint  distj-ibution  of 

lULlhll  Y  ^2n   -    ^2n  ^  ^^il-l^P 

1"^  ~  ^im  '         2n  ^  CT^^^  '         3p   -  03p 


converges   to   that   of    Z    ,    Z      and   Z    ,    and    if 
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2n        ,  ,         3p         , 

■ — —  ~*  \        and     -^  X        as      m,    n,    p 

a,           1  o„           2               .      •   i- 

Im  2n 


,2  2      2    ^1/2  ]'  ,2  2      2    ,1/2  "  2 


p  [z^  -  p,z^  ^^  t^a .pj  x^^/^  z^  -  P/3  -  s(i .p^  x^^/^] 


Proof  of  tlieorem  2.6.1. 


,2  2      2  ,1  2 

(^.   ^  Pn  ^o_) 


Im   '■^  1   2n 


/     2  '  2n\       /      lin  \ 


and 


^y2n-^2y3p^  -  ^^^2n-^2%^ 
,2      2   2  ,1/2 
^^2n  ^  P2  ^3p^ 


3p_ 

2    1/2 

2n 


{^<-¥)      (-^) 


2  2 

P2%3 


If  cp    (t,  ,t„,t„)  is  the  joint  characteristic  function  of  Y   ,  Y   ,  Y^ 
^mnp   1'  2'  3  ""  Im    2n    3p 


cp    (t  t  t_)  converges  uniformly  to  cp(t  ,t  ,t  ).   The  joint  character- 


mnp 
istic  function  of  the  random  variables 
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\. 

Y                                    Y 

2n                                2n 

^3P 

2   1/2 

^2        T ;^                     „2      1/2 

2         1/2 

P2% 

V^   '      2    2    ;           ^^   'P2      2  7 
Pl^2n                             ^.n 

is  given  as 


^2   1/2  ^,2   1/2  ^2    1/2 


Im  2n  Pi  2n 


^2    1/2 


which  converges  to 

But    (2.6.5)    is   tlie  joint    cliai'acteristic   fvinction   of    the  random  variables 


2,2,1/2    '  ,^         2,2,1/2 


Hence,  upon  appealing  to  the  uniqueness  theorem,  the  proof  is  complete. 
V.'e  now  proceed  to  investigate  the  three  types  of  distributions, 
beginning  with  the  Caiichy  type. 


2.7.   The  Asymptotic  Derivation  of  the  Generalized 
Bradley-Terry  Model  for  Triple  Comparisons 


The  Cauchy  Type  Distribution 

For  a  given  stimulus,  X.,  we  shall  assume  that  the  experienced 

sensation  y   ,  is  the  maximum  of  a  set  of  m  independent,  identically 
'   im 

distributed  random  variables  with  distribution  function,  F . ,  where 
F   (i=l,2,3)  is  a  Cauchy  type  distribution.   The  Cauchy  type  distribu- 
tion is  considered  first  because  the  sequences  [  [i.  ^^}  (i=l,2,3)  can  be 
taken  to  be  sequences  of  zeros,  and  the  limit  distribution. 


0  y  ^  0 

2       ex-p  -  (-y  )    y  >  0 


has    the   property 

-0/ 
y    (cy;C<)    =    [Y    (y;':*')]*^  for   c   real.  (2.7.1) 

2  2 

Let  us  suppose  that  a  subject,  when  exposed  to  three  stimuli, 

say  X,,  X^  and  X„,  compares  the  experienced  sensations,  y   ,  y^^,  y^^,   two 
1    2       o  '■ 

at  a  time  by  considering  the  ratios   y^/Ygn'  yinAsp  '"'^'^  ^2n''^3p* 

We  postulate  the  existence  of  a  thi'eshold  parameter,  T,,  whereby 
the  subject  assigns  the  pairwise  rankings  in  the  following  way. 

x.-x.    if    log  (Y.Jy.^^  >'n, 
x.=x.    if   I  log  (y.yyj,)  I  <^ 

and     X.-X.      if     log  (y.  /y.  )  <  -Tl  •  (2.7.2) 

J    1  im  jn 

The  subject's  total  ranking,  then,  will  depend  upon  the 
outcome  of  the  three  pairwise  comparisons. 


The  probability  of  a  consistent  untied  ranking,  say 
PCX^-*  ^2"  ^3^'    ^^   given  by 


-  ^f>'2n/>'l.  ^  ^"'^'  V^Sn^^""^^  •  ^^-^-^^ 


If  v/e  assume  that  the  conditions  of  theorem  2,6.1  are  fulfilled  with 

c      /o     —  X    ,    o     /o        —  \      and  Z   has  the  Cauchy  limit  distribution 
2n   Im   1'   3p'  2n     2      i 

given  in  (2,7.1),  then  (2.7.3)   becomes 


P^^l  -^  ^2  -^  S^    -   P^^'2n-  P  >'lm  "'  °'  ^3p  "  P  >'2n  <  °^ 

-^1  ■ 
where  p  =  e 

Upon  standardizing,  this  converges  to 


PEz^-P   K,'  \  <o,   Z3-P   x-^  z^<o] 


.-1  ^-l 


=  J  dY^Cy,;^')  J  ^'i'2^y2  =  ''^  /  ^'^2^y3'^^ 


1  +  (pXg^"'"'     1  +  (px;^"''  +  (p^x^^^^)"""  ' 


(2.7.4) 


For  p"*^  ^    6,      \~^^  IT   /n  and      \~°'  =  "'^o'^^'^l'    ^^^   '^''*"  ^^'^'^^^    (2.7.4)    as 

1=f  IT 

1  , ? (2,7.5) 

n2  n    +6n 

i=f  +en  +G  n  2        3 
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For  m,  n  and  p  large,  we  have  n^  ^   a^^,  n^  "^  ^ ^^   and  n^  cc:  q 
Since,  for  Cauchy  limit  distributions,  the  mode  of  y .  is 

I/O 

Y.  =  a.  (-^)     ,      (i  =  1,2,3) 
1    im  cv+i     ' 


»  0? 

When  G  =  1  or  equivalently ,  when  T  =  0,  (2,7.6)  reduces  to  the  model 
proposed  by  Bradley  and  Terry  given  in  (2,6.1). 

It  is  interesting  to  note  that  according  to  this  model,  no 
circular  triads  can  occur.  This  is  shown  by  the  following  theorem, 
v.hich  is  proved  in  the  framework  of  a  Cauchy  type  distribution. 

Theorem  2,7. 1. 

"  ''2 
Proof  of  theorem  2.7.1. 

^     2   y^^   P'    2    3   y^^   P 
Therefore,  since  all  quantities  considered  here  are  positive  and  p  <  1, 

•'Im 
However,  when  a  ranking  involves  a  tie,  basing  the  total  ranking  on 
just  two  pairs  may  lead  to  another  type  of  inconsistency  as  demonstrated 
by  the  next  theorem. 
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Theorem   2,7. 2. 


Proof    of    theorem    2.7.2, 


and 

^3  "*  ^1    "  >'lm/y3p  <  P  • 

These  two  statements  imply  that   y   /y    <  1  <  p   .   But  if  y   /y   <  ( 
then  X^  =  X3  or  X3  -^  X^. 

Let  us  nov.-  look  at  the  probability  of  a  single  tie,  say 
P[X  -  X  =X  ].   In  order  to  avoid  arriving  at  an  inconsistent  ranking, 
let  us  consider 

-^     ^     '^  ^2n         ^3p       ^3p 

^r   ^  ^Im  ^  ->     ^2n  .   -, 
=  P[p  <— -<  1.    7-<p:i 
^2n        ^3p 

^2n  ^  ,     ^Im 


P[p<_±ii  <  1,    _^  <  p]  .  (2.7.7) 


^Im         ^3p 


Define  the  events  A  and  B  as 


A: 

.^Im 

P       y 

^2n 

<  1, 

^3m 

B: 

^'^im 

<  1, 

^im^ 

V           P    • 
^3p 

After 

Stan 

dardizing. 

P[A] 
pXg^s 

converges    to 

(2.7.8) 


J  cIY^CYs;^)  J      dY^Cyg!^)  J     ^i'^Cyi;^).  <2.7.9) 

o  o  P'^1^'2 


which,  upon  substituting  iT^/n^  for  X^    ,   rt^/v^   for  X^   and  0  for  p   , 
reduces  to 


■n^ri^(Q-l)i^-j^+2Bii^-] 


(2.7.10) 


A  similar  expression  is  found  for  P[B]  b}^  interchanging  n^  and  n^. 
Hence,  we  find  that 

PEX^  -  X^  =  X^]  «P[A]  +  P[B] 

=  njn^(e-l)  f(^\,i^2'^3'®^  '  (2.7.11) 

where  f^n  ,n  ,n  ,6)  is  a  function  synmetric  in  n   and  it  .   As  in 
(2.7.6),  we  can  express  this  probabilitj'  in  terms  of  the  sensation 
parameters,  Y  ,  Y   and  Y   as 

PLX^  -  X^  =    X^]  ^^   (Y^)^  (Y^)^  (e-1)  f^Y^,  Y^,  Y^,  6).     (2.7.12) 

When   considering   the   event    that    the   outcome    is    tlie   triple   tie,    say 


C:      p<_±.<p-,      p<-^<P       ,      P<r^<P       .  (2.7.13) 

^2  ^3  ^3 

The  region  C  can  be  partitioned  into  two  disjoint  regions,  P  (2,3) 
and  ^2^2, 3)  where  C  =  P(2,3)  =  P^(2,3)  U  p2^2,3)  and  P^(2,3)  and  P^2,3) 
are  defined  as 


P^(2,3)  = 


y2<y3 


<  V   <  V 


Yo  p  ^  y. 


^3    ^2 


^2^2, 3)  -  <  72  P  <  ^1  <  ^3  P 


y^  <  y„  <  Yo  P 


(2.7.14) 


It  is  immediately  evident  that  P(2,3)  =  P(3,2),  i.e.,  the  region  C  is 
symmetric  in  y   and  y  .   It  is  easily  seen  that  by  using  the  partition 
P(l,3),  that  P(l,3)  =  P(3,l)  and,  using  the  partition  P(l,2),  that 
P(l,2)  =  P(2,l).   In  fact,  it  can  be  showii  that 

C  =  P(l,2)  =  P(2,l)  -  P(l,3)  =  P(3,l)  -  P(2,3)  =  P(3,2); 


that  is,  the  region  C,  or  more  simply  the  range  of  integration,  is 
symmetric  in  y  ,  y2  and  y^.   Hence  we  can  write 

Pf^  =  \  =   ^3^  "'/'fJ'  ciY^Cy,;^)  ciY^Cyg;^')  ^^^^3'"'^    '      ^^-'-'^^ 

where  P  is  one  of  the  six  equivalent  partitions  of  C.   Upon  integrating 
and  substituting  n^ ,  i^^'  ^^^3  ^"^  ®  ^^  before,  we  find  that 


nx^  =  \  =   X3]  ^."Jv'ce-D  S3(^."2'^^3'®^' 


(2.7.16) 


where  g^it  ,tt  ,tt,  ,0)  is  a  function  symmetric  in  the  parameters  i=r^ ,  tt^  and 
IT  .    In  terms  of  the  sensation  parameters  Y^ ,  Y2  and  Y^,  we  can  say  that 


P[x,  =  x^  =  X3] ..  ,,y  <Y«)^  i.y  (8-1)^  ^<.^»^ 


(2.7.17) 


In  examining  (2.7.11),  the  probability  of  a  single  tie  and 
(2.7.16),  the  probability  of  a  triple  tie,  we  note  that  when  6^1, 
(T|  =  0),  then  each  of  these  events  has  probability  zero. 


The  Exponential  Type  Distribution 

As  in  earlier  sections  we  shall  assume  that  y.  ,  the  response 
to  stimulus  X.,  is  the  maximum  of  a  set  of  m  independent,  identically 
distributed  random  variables  with  a  common  exponential  type  distribu- 
tion. We  postulate  the  existence  of  a  threshold  parameter,  T],  whereby 
a  subject  will  report 


and 


^i 

-• 

^j 

if 

^m 

- 

^jn  >  ^    ' 

^i 

= 

s 

if 

l^m 

- 

^jn    1    <  ^ 

^J 

- 

\ 

if 

^m 

- 

^jn<-'^      • 

(2.7,18) 


For   V        -    max    (u    ,u    ....    u    )     (i=l,2,3)    and   properly    chosen 
■^im  12  m 

sequences, f H.    ]    and   fu.    ]    , 


lim     P 


-  Y^(y) 


for 


<  y  < 


Let  us  consider  the  probability  of  an  untied  ranking,  say 


'^\   "S--   S^    =   Pf>^l™-^2n>^'  ^I.-^SP^'^'  y2n->-3p>'^^ 


Pt^'l.-^'sn^^''  ^'2n-y3p>^l 


Pty2n-^ln.<-^'  ^Sp-^Sn^-^^ 


(2.7.19) 


Now  if  a   /a   ->  \      and  a      /a^     ->  X„,  then  by  theorem  2.7.1  we  know 
2n   Im    1       3p   2n    2 

that  for  p^  =  p^  =  1, 


<  t 
2      2  ,1/2         1 


-.p[z^-z^<t^(i.X-2)^' 


^y3.ry2n^  -  ^^^3p-^2n^  ^  , 
,  2      2  ,1/2         2  , 
(^3p  ^  ^2n^  J 

<t.(i.x-)^/^L 


(2.7.20) 


I'hich    for   the    ex]3onential    type   distribution   equals 
1 1    +    e        I         .    |l    +    e  +    e  J 


(2.7.21) 


for      t'    =  t(l    +   X/)^^^      and      t'    =    t    (1   +   X"^)"^^^.      For   large  values 
111  2  ^  ^ 


2     „2     ^2 

Im     2n     3p 


of  m,  n  and  p  with  X^  =  X^  =  1,   ^^   «  6-  ^  g„   and  we  can  write 

o^  +  C^  -  P^   +  O^  Ri  ff^.   Hence, (2.7. 21)  is  then  approximately 
Im    2n  "^  2n    3p    d 

equal  to 


(^^'2n-^^lm^     2T1    ^^^3p-^^2n^ 


-n    ^^^3p-^2n^ 


r  •  {> 


}  ■ 

(2.7.22) 


log  (ng/n^)  =  ^^P"^^"  ,  log  (iT^/n^)  =  1^2|_^  ^^^^  6  =  e*^  ,        (2.7.23) 


can  be  written  as 


P[X  --  X  -  X  ]  « ^   2   '  n  +L   • 

1     2    3    ,,_^^en^+e\^   "2^'''3 


(2.7.24) 


For  large  values  of  m,  n  and  p,  log  if. 


(ir=l,2,3)  and  (2.7.24) 


be  written  in  terms  of  the  true  sensation  parameters  Y  ,  Y   and  Y  , 


P[X^  -  S  -   X3I 


c 

2 

a 
e 

^3 

^'2              ^3 

e"    .    ee" 

(2.7.25) 


for   C  =  P 


In  a  manner  similar  to  that  for  the  Cauchj'  type  distribution; 


P[X. 


^'2=  >^i^-V2^'-^^  ^(^'"2'"3'^> 


with   f,(",  ,''T„,'''fo>  ^)  ^  symmetric  function  of  rt   and  Vf  ,  whil 


e  for  the 


triple  tie,  X^  =  X  =  X^,  we  find 


P[X^  =  \  =    V  -  V2^^3(^-^>'  %^"l'^"^2''^3'^) 


g,("    j'i'T    ,1T    ,  0)    a   syiimietric   fimction  of   It    ,    it      and  n. 


The  Limited  Type  Distribution 

For  a  limited  type  distribution,  F,  there  exists  a  constant, 

(jD,  satisfying  the  conditions  F(lij)  =  1   and  F(a:-e)  <  1  for  every  e  >  0. 

Let  us  assume  that  in  response  to  stimulus  X.  ,  experienced  sensation, 

y   ,  is  the  maximum  of  a  set  of  m  independent,  identically  distributed 
im 

random  variables  with  a  common  limited  type  distribution.   In  the 


estimates,  are  available  and  that  the  subject  bases  his  decision  on 
the  ratios 


^im 

-^1 

>^lm 

-^ 

and 

y2n    - 

■"^2 

y2n 

-  '^2 

^'3p 

-^3 

^3p- 

^3 

and  reports  that 


X.  -   X.      if     log  (-i^)  <  -  Tl  . 

X  =  X       if    I  log  (-^i!i-i)  I  <  Tl  (2.7.26) 


and 


X.  -^  X.        if        log  (-J^ii-^)  >  ^^ 


Consider  the  probability  of  an  untied  ranking,  say, 
P[X   -^  X  -*  X  ],   Then  according  to  (2.7.26), 


yim-^l   <     -T\        yim-^^l   <     -Tl        y2n^2  <  ^-Tl 


2n     2 


'3p^3 


lm"^'l    ^      -11         ^2n-^2   ^      -11 


y3p-"^3 


y2n-'"2  ^     Tl  ^31.-^3  ^     11 


>   e  ', 


V  ~'d) 


(2.7.27) 


^[^■^^2-^3^    -    {^>'2n-V    -    ^"^^^'im-l^    <  °'     ^^^Sp^S^  "  ^'^^y2n--2>    <  °J 


(2.7, 28) 


For  p    =:    e',    upon   standardizing    (2.7.28)    we   see   that 


Pt^'r^S-V    -^^f^2-P    ^       ^<°'       ^3-pS      ^2<°^ 


for  y  <  0,    is   equal    to 


a^  -a         -2<y^  -ov  -a  -»  -a 


(2.7.29) 


1  +p     Xj     +  p       x^ 


X„  1    +   D       X, 


Upon   establishing   the   correspondence  given   by      6  =  p       ,    "q/''^o  =    '^o" 
and  TT^/fT     =  X      ,    we  note  that 


P[X^  -  \  -  X3]    « 


^  r2  n      +    err 

"1    +    ^^"^2   ^    ^   "2  ^  2 


(2.7.30) 
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For   large  values   of   m,    n   and  p,    we  may   take 


X,    ?a  and      X, 


3p 


Im  2n 

-0!  -0! 

Therefore,  for   large  numbers   of    signals,    n     ^  Cf      ,    tt      ^  g        and 

1  Im'       2  2n 

-0! 
Tt      cc  O      .       In   order   to   show  the   relationship   of    (2.7.30)    to   the   sens£ 


Q'-i  i/<y 

limit  distribution  is  given  as   Y  =0)  +   o        ( )    ,   Hence,  v      is 

i     i     im.   «  i 


-CV 
^-2  -  ^2^ 


P[X  -  X  -  X  ]  «  — -^^ 

(2.7.31) 

In  a  manner  similar  to  that  given  for  the  Cauchy  type  distribution,  we 

find  that  tlic  probabilities  for  single  and  triple  ties  have  the  same 

form  as  (2,7.11)  and  (2.7.16)  developed  for  the  Cauchy  type  distributions. 

If  U)  ,  u^   and  x'   are  unknown,  the  results  are  imchanged  if  con- 
sistent estimators  of  these  parameters  are  available.   Theorem  2,5.1 

remains  valid  for  each  of  the  three  random  variables  (y.   -  tu .  )/o. 

im   im   im 

(i=l,2,3)  and  the  function  g(x)  given  in  the  paper  by  Mann  and  Wald  [14] 
can  be  taken  to  be 

.        .        .  ,    /^im  -  ^1    y2m  -  ^2\ 

e(^'  ^2'  V  =  [ ' r)  • 

y2n  -  "^2    y3p  -  "^3 


Then 


^yn„,  -  '^^.       yon  "  ^2\    D 

— -)     -  (z-  ,  Z') 


•'2n    : 
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(ZJ ,  Z' )  is  the  limiting  random  variable  defined  by 
^9.  -  ^o\   D 


l^^lm   ^1    12r^_2\ 


^      V    —  rn  y 


or  their  consistent  estimators  are  used. 

2.8,   Comments  Regarding  Results 

It  is  interesting  to  note  that  using  the  limit  theorem  approach 
and  considering  the  sensation  response  as  the  maximum  of  a  large  number 
of  signals,  we  arrive  at  generalized  Bradley-Terry  models  for  both 
pairwise  and  triple  comparisons.   In  both  cases,  when  6,  the  threshold 
parameter,  takes  the  value  one,  tl:e  models  reduce  to  the  untied  models. 
However,  we  also  note  that  the  generalized  triple  comparison  model  ari-ived 
at  using  limit  theorems  is  not  a  practical  model  in  application  for  the 
following  reasons.   First,  the  forms  of  the  probabilities  for  single  and 
triple  ties  are  too  unwieldy  to  be  easily  handled.   Secondly,  this  model 
lacks  symmetry  and  reversibility.   Reversibility  is  used  here  in  the  sense 
defined  by  Pendergrass  [19]-   A  model  is  said  to  be  reversible  if  the  form 
(and  hence  the  value)  of  the  probabilities  is  unaltered  if  the  least 
desirable  item  is  assigned  rank  one  and  the  most  desirable  item  assigned 
rank  three,  rather  than  using  the  standard  procedure  of  using  rank  one 
to  designate  the  best  and  rank  three  to  designate  the  worst  item. 
Thirdly,  these  probabilities  are  not  independent  of  the  order  in  which  the 
ranks  are  assigned.   Lastly,  since  inconsistent  rankings  can  occur  when 


ties  are  present,  the  probabilistic  model  would  necessarily  have  to  be 
conditioned  on  the  event  that  no  inconsistent  rankings  occur,  which 
would  make  the  form  of  the  probabilities  even  more  unwieldy. 

For  these  reasons,  we  turn  our  attention  to  the  problem  of 
developing  a  tie  model  for  triple  comparisons  that  overcomes  most  of 
these  difficulties. 


CHAPTER  3 


GENERALIZATION  OF  THE  BRADLEY-PENDERGRASS  MODEL 


3.1.   Introduction 


In  the  investigation  of  rank  analysis  of  triple  comparisons, 

models  have  been  postulated  as  generalizations  of  pairwise  comparison 

models.   Two  such  models  specify  that  the  t  treatments  to  be  compared 

have  true  ratings,  ti  ,  tt  ,  ,  n  ,  on  a  subjective  continuum  such  that 

n 
TT   S:  0    (i  =  1,2  ...,t)  and  E  n  -  1,  the  latter  condition  imposed  to 

i  i=l   1 

ensure  determinacy  of  the  ratings.   A  terse  examination  of  these  two 

models  and  their  properties  will  be  beneficial  in  considering  any 
generalization  of  a  triple  comparison  model  to  account  for  the  occur- 
rence of  ties  in  the  rankings. 

Model  I 

Bradley  and  Terry  [4]  proposed  a  model  wherein  the  probability 
that  treatment  i  obtains  top  ranking  in  the  triple  com.parison  of  treat- 
ments i,  i  and  k  is  n  /(n  +11   4  n  )  and,  when  this  has  occurred,  the 
'  i    1    J     k 

probability  that  treatment  j  outranks  treatment  k  is  IT  /(n.  +  TTj^) . 
Hence, 


p[i  -  j  -  k]  .  ^^;,,_  ,,  )  •  oT-no  •  ^'-'-'^ 


j    k      j    k 


This  model  has  the  desirable  property  that  the  unconditional  prob- 
ability that  treatment  i  outranks  treatment  j  is  Tf./(if  +  '^   )  ,    the 
same  probability  as  in  paired  comparisons.  •  However,  this  model  does  not 
have  the  property  of  being  reversible  in  the  sense  that  the  probabil- 
ity given  in  (3,1.1)  does  not  retain  its  form  wlien  the  direction  of 
ranking  is  reversed. 

Model  II 

A  second  model  has  been  proposed  by  Bradley  and  Pendergrass  [20] 
whereby  the  three  treatments  (i,j,k)  are  tacitly  compared  two  at  a  time 
until  a  consistent  ranking  of  tlie  three  treatments  is  attained.   This 
model  is  given  as 

P[i-j-k].— 2"^-^ 2 •  ^^-^-^^ 

IT   (n  +Tf   )   +  ff   (11  +rf   )   +  n,  (rt.+n.) 
ijk  jik  kij 

This  model  has  the  property  that 

P[i  -^  J  I  i,J  -k]  =  P[i  -  j  I  k  -  i,j]  =  lT./(".  +  l^j), 

the  same  probability  as  in  paired  comparisons.   In  addition  to  having 
the  property  of  reversibility,  the  model  is  also  unaffected  by  the 
order  of  assignment  of  the  ranks.   This  last  property  is  important 
since  in  some  exiperiments,  it  may  be  easier  to  choose  the  worst   item 
or  treatment  first,  while  in  others  it  may  be  easier  to  choose  the 
"best"  first, 

Pendergrass  [19]  reports  that  both  models  yield  similar  results 
in  applications  and,  as  such,  leave  little  to  clioose  between  them. 


However,  mathematically,  model  II  is  to  be  desired  because  of  its 

reversibility  and  symmetry.   We  therefore  chose  to  generalize 

this  model  to  account  for  ties  that  occur  in  such  ranking  experiments. 

Before  proceeding  with  any  generalization,  we  note  that  for  the 
Bradley-Pendergrass  model,  P[i  ■"'  j  "*  k]  is  actually  a  conditional 
probability,  conditional  upon  the  event  C,  that  no  inconsistent  ranking 
of  the  three  treatments  occurs.   This  is  easily  seen  if  we  consider  the 
triple  comparison  of  items  i,  j  and  k  as  consisting  of  the  three  inde- 
pendent pairv.ise  comparisons  involving  i  and  j,  i  and  k,  and  j  and  k. 
In  this  light, 

P[i-j-k]  =  P[i  -  j]  •  P[i  -  k]  •  P[j  -  k] 

n  n  TT 


1=1. -in         n.+Tf,        i=T.+n, 

1  J  1      k  J      k 

1      J 
= .  (3.1.3) 

2  2  2  V    .     .     / 

P.(iT.4n  )   +  IT.  TT.+n  )   +  TT,  (n.+n.)    -  2n.n.n 
ijk  jik  kij  ijk 

An  inconsistent  ranking  would  occur  if  either  of  two  circular  rankings, 
called  triads,  occur.   The  first  triad  would  result  when  in  the  tliree 
pairwise  comparisons,  (i"^j)  ,  (j'^k)  and  (l~»i)  whicli  gives  the  total  rank- 
ing as  (i  -•  j  -•  k  -•  i) .   The  secoiid  triad  would  result  wlien  (j~*i)  , 
(Ir-'j)  and  (i-k)  resulting  in  the  circular  ranking  (k  -^  j  -»  i  ^  k) . 
The  prcbabilitj-  that  a  given  triad  occurs  is 


1  J  1^ 


(iT.+iT .)  (n.+n  )  (n.+rr  ) 
1  J    1   k   J   k 


Hence,  the  probability  that  no  triads  occur  is  given  as 

2ff      n.    Tl  (".+1T.)  (n.+IT    )  (IT.+IT,  )     -    21T.TT.rT, 

,        i     J      k ^        1      J        1      k       J      k 1   J    k    _         (3   14) 

"  (n.+TT.)(n.+n    )  (n.+u  )  (ii.+n  .)  (n.+n  )  (n .+n  ) 

ijikjk  ijikjk 


Using  (3..1.3)  and  (3. 1.4),  we  see  that 


PEi-j  -k  I  c] 


(n.+n.)OT.+n  )Ot.+n  ) 
1  J    1   k   J   k 


(n..n.)(n..n^)(n..n^)    ^,2^^^     ^  n^cn.-M.  )  .  ..f(i,..tt.) 
ijk     jik     Kij 


i   J 


11^(17  +n,  )  +  n^(n.+n,  )  h  n  (n.+n.) 
ijk     jik     kij 


(3.1.5) 


wliich  is  the  probability  given  by  the  Bradley-Pendergrass  model 
in  (3.1.1). 

3.2.   The  Devclopinent  of  the  Generalized 

Bradley-Pendergrass  Model 
for  Triple  Comparisons 

As  we  have  seen, the  Bradley-Pendergrass  triple  comparison 
probability  model  is  actually  a  conditional  probability  based  on 
three  independent  pairwise  comparisons, using  the  Bradley-Terry  model 
for  each  pairwise  comparison.   In  the  generalization  of  the  Bradley- 
Pendergrass  model  to  include  tied  rankings, we  shall  also  use  a  condi- 
tional probability  based  on  three  independent  pairwise  comparisons, 
using  the  probabilities  of  Rao  and  Kupper  for  the  outcomes  associated 
with  each  paired  comparison  (see  equations  in  (2.2.G)). 


With  the  introduction  of  a  tie  parameter,  B,    into  the  model, 
we  should  keep  tlie  following  criteria  in  mind.   (See  [7],) 

1.  The  tie  model  should  reduce  to  the  untied  model  when  6=1. 

2.  The  probability  of  a  triple  tie  should  tend  to  one  as  9,  the  tie 
parameter, tends  to  infinity,  while  the  probability  of  any  other 
ranking  should  tend  to  zero. 

3.  The  tie  model  sliould  have  the  property  that 

P[j  -'  k  I  j,k  -  i]  = 


P[j  -  k  I  i  -  j,k]  =  n./(ff.  +  eiT^^) 


(3.2.1) 


4.  V/lien    6=1    and  v      =   —   (i   =    l,...,t),    each   untied   ranking   should 

i    t 

have  probability  one-sixth,  while  for  IT.  =  —  (i  =  l,...,t),  the 
probability  witliin  each  of  the  three  types  of  outcomes  (no  ties, 
one  tie,  three  ties)  should  be  the  same. 

5.  T]ie  complete  set  of  probabilities  sliould  have  a  common  functional 
form  for  all  outcomes. 

To  develop  a  generalized  Bradley-Pendergrass  model  with  a  tie  parameter 
as  a  conditional  probability,  given  no  inconsistent  ranking,  we  must 
consider  twenty-seven  outcomes  based  on  three  pairwise  comparisons, 
since  each  pairwise  comparison  has  three  possible  outcomes.   Of  these 
twenty-seven  distinct  outcomes, 

1.  six  result  in  consistent,  untied  rankings, 

2.  six  result  in  consistent  2'ankings  with  one  tie, 

3.  one  results  in  a  consistent  triple  tie  and 

4.  fourteen  result  in  inconsistent  rankings. 

Tlie  following  notation  is  introduced  to  facilitate  the  development 
of  a  triple  comparison  tie  model : 
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Symbol 

1. 

D.  . 

2. 

"ijx 

3. 

«..,- 

Definition 


1  J 


(TT.+eTT.)(iT.+ei7.)(i-i.+en  )(iT  +e-7.)(Ti.+e,7  )(it  +Q]i  )  , 

ijjiikkijkkj' 

iik  Q.  .,  /D.  .,     is    the   sum  of    the  probabilities    asso- 

ijk      ijk 

ciatcd  with    the  fourteen   inconsistencies     and 

3.       A.  .,  D.  .,     -    Q.  .,    .  (3,2.2) 

ijk  ijk  ijk 

After  some  manipulation  Q.  .,  and  A.  .,  can  be  written  as 
^ijk      ijk 

Q.  .,  =  V'.i^.i^  [D..D.  D,  .  +  D.  .D   D   ][ 
^ajk    L  1  J  k   ji  ak  kj     ij  jk  ki  J 

4    (S^-1)    i^/'.T,     [D..D    .    +   U    .D.J    +   n.TTjT      [D    .D.      +   D.  .D    .] 
t   i   J    k        ji    kj  ki   jk  1   J    k        kj    ik  ij    ki 

+   n.l^Tif    [D.,  D.  .    +   D.,  D..]f 
1   J    k    ■-    Jk    ij  Ik  ji  J 

+    (G^-1)^  l-V:'\     [D    .    +   D    .]    +  lA.nf    [D.  .    +   D.,  ] 
L   i   j    k        ki  kj-"  1   J    k        ij  ik 


^   '\'''j\    f^i    ^   ^JkV 


and 


A  =   Tr\.    D      D      D         +    n^n      D..D,   .D.,     +   n.n,     D..D.    D., 

ijk  i    J      ji    ki   kj  i    k      ji    ki   jk  i    k      ji    ik  jk 

+   n  n^   D      D      D        +   llV     D.  .D.    D,   .    +   n.iT      D.  .D.    D., 
i   j      ij    ki   kj  J    k      ij    Ik   kj  j    k      ij    ik  jk 

+    (6^-1)   iTf^n  17     D     D       +  rr  17^tt     D     D       +17  n  n     D.    D. 
^    ^^     ■'''    I  i   j    k     ji   kj    ■       ijk      ij    kj  ijk      ik  J 

+   rA^   D      D        +   VfV    D..D.,     +   VI V   D.  .D.    1 
i   j      ki   kj  1   k     ji   jk  J    k      ij    ikJ 

+    (6^-1)^   {"^^^'S    •  (3.2.3) 


jk 


Having  displayed  these  quantities,  we  note  that,  for  the  event  C,  the 
occurrence  of  no  inconsistencies,  P[C]  is  given  as 

PEC]  =    1    -'^=^.  (3.2.4) 

ijk     ijk 

Conditional  on  C,  we  can  now  write  the  probabilities  associated  with 
the  three  tj-pes  of  consistent  outcomes.   As  examples,  consider  the 
following  outcomes  for  the  triple  (i,j,k). 

1.  No  tie: 

rr^rr   D  D  D 

P[i  -^  j  -^  k  I  c  ]  =  -i-J-J-UiiJsi  .  (3.2.5) 

^jk 

2.  One  tie: 


n^i^  D,  .D,  .(8^-1) 

(a)  P[i  .  J  -^  k  I  C]  =  '   '      f  "^ , 

^jk 

n^n  HDD   (G^-1) 

(b)  P[i  -^  j  =  k  I  C]  =   ^  J  \^^  ^^ 


(3. 2.6) 


3.   Triple  tie: 


n^TV  (02-1)3 


P[i  -  j  =  k  I  C]  =   ^  ^    ^l .  (3.2.7) 

""ijk 

That  tliese  probabilities  exhibit  the  five  criteria  listed  earlier  is 

easily  shown. 

1.   By  examining  A.  .,  in  the  form  given  by  D.  .,  -  Q.  .,  ,  for  0=1, 
ijk  -^   ijk    ijk' 

we  see  that  D   =  D    and  hence 

A..,  =D..D.,D..  [D.  .D.  D.,  -2n.n.l-l 
ijk    ij  ik  jK    ij  ik  jk     1  J  k 


Therefore,  when  6=1,  the  probability  of  an  untied  consistent 
ranking  is  given,  for  example,  as 

1   J 


P[i  -  J  -  k  I  C]  =  ^-^-^ 


_   „       2TT  17  IT   ' 
ij  ik  jk     i  j  k 

the  Bradley -Pendergrass  model.   For  0=1,  all  probabilities  involv- 
ing a  tie  are  identically  zero, since  these  quantities  contain  the 


2.  Noting  that  A    =  D    -  Q  .,  is  a  polynomial  of  order  6  in  6  and, 

ijk     ijk     ijk 

in  particular, D     is  of  order  6  while  Q  .,  is  of  order  5,  when 
'  ijk  ijk 

6  tends  to  <=,  probabilities  of  the  form  (3.2.5)  and  (3.2.6)  tend 
to  zero  since  the  numerators  for  tliese  quantities  exliibit  the  high- 
est power  on  6  as  tlie  fourth  power.   To  show  that  the  probability 
of  a  triple  tie  tends  to  one  as  Q-><^,    divide  both  numerator  and 
denominator  by  0  .   The  numerator  tends  to  vi.n.n  while  in  the 

denominator,  A.  .,  =  D.  .,  -  Q.  .,  ,  D.  .  /B^  tends  to  nj-r^rrf  and  Q.   /G 
'   ijk     ijk     ijk'   ijk  1  J  k      ijk 

tends  to  zero.   Thus  the  probability  of  a  triple  tie  tends  to  one 

as  9  tends  to  infinity,  independently  of  TT.  ,  n.  and  17  . 

1        J  K 

3.  To   demonstrate   that   P[j-*k  |  i-j,k]    =   if  ./(t?  .  +  6n^)  ,    we  note   that 

P[i-^j,k]    =   PEi-j-^k]    +  PEi-k-j]    +  P[i-j  =  k]. 

Then 

It  ^17      D      D      D    . 

„r  ■      ,    I    •        ■    ,  T         i    j      ji    ki    kj 

P[j  --k  I  i-j,k]    =   -^ 2 2  12 

17    17   D      D,   .D     .+17.17    D,   .D..D.    +17.17.17   D..D       (9    -1) 
i    j    ji    ki    kj       1    k   ki   ji   Jk      i    j    k  j  i   k--- 


"j  "w 

".1  \i 

-1) 

^1.  \i 

17.  +  en-    • 

.     J            k 

In  a  similar  manner,  we  can  show  that 
P[j  -  k  I  j,k  -  i]  =  '^j'^^^j^^'k- 


4,  If  e  =  1  and  P.  =  -  (i  =  1 , .  .  .,t) ,  only  (3.2.5)  is  non-zero  with 
probability  one-sixth. 

If  ©  >  1  and  n.  =  i-  (i  =  1,.  .  .  ,t),  then 

(a)  the  probability  of  a  non-tied  ranking  is  (1+0)  /©, 

2   2 

(b)  the  probability  of  one  tie  is  (1+9)  (6  -1)/©,  and 

2    3 

(c)  the  probability  of  a  triple  tie  is  (6  -1)  /© , 

where  S  is  A    evaluated  at  n.  =  it  .  =  it   =  -.   Hence,  the 
ijk  1    J     k   t 

probabilities  are  the  same  for  outcomes  within  a  given  type. 

5,  To  show  tliat  all  probabilities  have  a  common  functional  form, 
we  define  the  following  parajiieters.   For  the  r   replication  of 
triple  (i,j,k)  (i  t^  j  t^  k;  1  ^  i ,  j  ,k  ^  t)  ,  write 


'"ii(k)r   I 


1  if  i-*j  in  the  r   replicate  of  (i,j,k) 


0  otherwise. 


1  if  i=j  in  the  r    replicate  of  (i,j,k) 


^ij(k)r  =  1q  otherwise. 

r       -    a       +  b  (3.2.8) 

^ij(k)r  -     ij(k)r  ^  °ij(k)r- 

For  the  present  we  assume  that  there  is  only  one  replicate  of  each 
triple  and  drop  the  subscript  r  for  simplicity. 

If  (m,n,p)  is  a  permutation  of  the  triple  (i,j,k),  we  can  write 
the  probability  of  a  consistent  outcome  involving  the  triple 
(ij,k)  as 


Z  c 

n  (tt  -^p 

\  m 


mii(p). 


n    D 


nm(p) 


9    2   ,  ,^   mn(p) 

r-1)  '^^^^^  P 
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(3.2.9) 


ijk 


where  the  products  and  sums  are  over  the  six  permutations  of 
(i,j,k).   Therefore, (3. 2, 9)  exhibits  a  common  functional  form  for 
the  probabilities  associated  with  each  of  the  possible  outcomes 
for  tlie  given  triple  (i,j,k). 

In  addition  to  the  properties  listed,  this  generalized  model 
is  reversible.   Suppose  rank  one  is  assigned  to  the  "best"  item  and 
rank  three  to  the  "worst";  then  as  a  specific  example 


P[i  -  j-^  k] 


'.r-.  D..D,  .D,  ./A.  ., 
1  J   ji  ki  kj   ijk 


(3.2.10) 


However,  if  rank  one  is  assigned  to  the  worst   item  and  rank  three 
to  the  "best,"  then  the  equivalent  ranking  for  (3.2.10)  would  be 
k  -•  j  -  i  and 


P[k 


i] 


\  3.  G.  G.,  G.  ./C.  .,   , 
k  J   Jk  ik  ij   ijk 


(3.2.11) 


satisfying 


C.  .,  =  A.  .,  (3.  ,P.,6  )  with  3. 
ijk     ijk   1   J   k        1 


and 


h "  "i 


and  5^ 


(3. 2.12) 


Hence,  if  the  rr   exist  and  are  non-zero,  then  the  3.  exist  as  param- 

i  1 

eters  and  have  the  same  relationship  to  rankings  in  the  reverse  direc- 
tion as  do  the  ii .    to  the  original  ranking. 


Since  the  tie  model  proposed  in  (3.2.5),  (3,2,6)  and  (3.2.7) 
or  equivalently,  (3,2.9)  has  the  propertj'  of  conditional  independence 
of  the  ranking  of  a  pair  of  items  when  the  third  item  has  been  ranked 
either  first  or  last,  the  question  of  the  possibility  of  complete  inde- 
pendence of  the  rank  of  the  third  item  in  the  triple  arises  quite 
naturally. 

With  S  =  l,  the  proposed  tie  model  reduces  to  the  Bradley- 
Pendergrass  model  with  six  possible  untied  rankings  of  the  items  in  the 
triple  (i,j,k).   In  this  simpler  case,  the  condition  of  complete  inde- 
pendence requires  that  the  model  satisfy  the  condition, 

P[i  -  j  I  r^^  =  1]  -  P[i  -  j  I  rj_  =  2]  -  P[i  -  j  I  r^^  ^    3]  ,       (3.2.13) 

where  r   is  the  rank  of  item  k.   Pendcrgrass  [19]  has  shov.-n  that  this 
condition  is  satisfied  only  when  the  six  probabilities  corresponding 
to  the  six  possible  rankings  are  all  equal.   Hence,  there  can  be  no 
general  untied  model  satisfying  (3.2.13).   Since  a  generalized  model 
allowing  for  ties  must  reduce  to  the  untied  model,  the  untied  model  is 
just  a  special  case  of  a  tie  model  for  certain  values  of  the  "tie" 
parameter.   Hence,  it  follov/s  that  there  can  be  no  general  tie  model 
satisfying  (3.2,13). 


CHAPTER  4 


ESTI^i^TION  AND  TESTS  USING  THE  GENERALIZED 
BRADLEY -PENDERGRASS  MODEL 


4.1.   Maximum  Likelihood  Estimation 

In  tliis  section  we  will  consider  a  method  for  obtaining  maximum 
likelihood  estimators  for  the  parameters  of  tlie  modified  triple  compar- 
ison model. 

Let  t  represent  the  number  of  treatm.ents  or  items  under  consid- 
eration in  an  exiieriment.   A  complete  rejielition  is  defined  to  be  the 
set  of  all  possible  distinct  triples  that  can  be  formed  with  the  t 
treatments.   V/lien  t^3,  there  are  (  )  triples  in  one  complete  repetition. 
The  niimber  of  complete  repetitions  in  the  experiment  is  denoted  by  n. 

The  variables  a..,,.  ,  b...,  ,   and  c...,  ,   defined  in  (3.2.8) 
ij(k)r'   ij(k)r      ij(k)r 

are  random  variables  depending  upon  the  ranks  of  treatments  i,  j  and  k 

in  the  r    repetition  of  the  triple  (i,j,k),  (i^^jj^k;  is;i,j,ks:t; 

r  =  1,2,. . . ,n). 

In  order  to  avoid  confusion  resulting  from  the  use  of  the  dot 

notation  to  indicate  the  sunimation  over  designated  subscripts,  we 

shall  agree  to  use  the  following  notation  when  possible. 

Write 

(i)   a      =  E  a   .  .  ;  this  is  the  number  of  times  i  is  preferred 
ij(k)    J,      ij  (k)r 


to  j  in  the  presence  of  k. 
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(ii)   a   =  2]  a   ,,  .  ;  this  is  the  number  of  times  i  is  preferred  to 
ij    k   iJ(i^) 

j  in  the  e:-q3eriment. 

(iii)   a  =  H  a   :  this  is  the  number  of  times  i  is  preferred  to  some 

other  treatment  in  the  exjijeriment. 

(iv)   a  =  E  a.  ;  this  is  the  nvimber  of  times  a  preference  is  stated  in 
i   ^ 

the  experiment. 

(v)   b.  .^,  ,  =  E  b.  .  .,  .  ;  this  is  the  number  of  times  i  is  tied  with 
ij(k)    p   ij(k)r' 

j  in  the  presence  of  k. 

(vi )   b.  .  =  I!  b.  ..,  ,  ;  this  is  tlie  number  of  times  that  i  is  tied  with 
ij    k   ij(k) 

j  in  the  exjjeriment. 

(vii)   b.  =  E  b.  .;  tJiis  is  the  number  of  times  that  i  is  tied  with  some 

other  treatment  in  the  exi^eriment. 

(viii)   b  =  E  b. ;  this  is  twice  the  number  of  ties  in  the  experiment. 
i   1 

It  follows  from  (3.2.9)  that 

(ix)   c.  .  .,  .  -  E  c.  .  ,,  .   is  the  number  of  times  that  i  is  preferred 
ij(k)    r   3j(k)r 

to  or  tied  witli  j  in  the  presence  of  k, 

(x)   c.  .  =  E  c.  .  ,,  .  is  the  number  of  times  that  i  is  preferred  to  or 
ij    k   ij(l^) 

tied  with  j  in  the  experiment, 

(xi)   c.  =  E  c. .  is  the  number  of  times  i  is  preferred  to  or  tied 

with  another  treatment  in  the  exToeriment,  and  finally, 

(xii)   c  =  E  c.  is  the  number  of  preferences  plus  twice  the  number  of 
i   ^ 

ties  in  the  experiment. 

Using  the  parameters  just  defined,  we  can  write  the  likelihood 
function  for  n  replicates  of  the  (  )  treatment  combinations  as  propor- 
tional to 
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t        c.-i      p   t        a.  .-| 

n    n.M      n    D.^J    (6-1) 


L(n^,...,TT^    B)    =   -±^ ^ iiJ ,  4.1.1) 

n     [A..j^ 

i<j<k    ^^^ 

,Ti   6)  is  proportional  to 


Z   c.  In  TT.  +  -  In  (6^-1)  +  T.      a  .  In  D 
i=l   '      ^2  i;^j  ^'  ' 


t 


Z   In  A.  .,     ,  (4.1.2) 


Maximizing  the  logarithm  of  the  likelihood  function  under  the  restriction 

t 
that   T     'n   =  1 ,  we  find  that  the  maximum  likelihood  estimators, 
i=l   1 

D   (i  -  1 t)  and  G.of  tt   (i  =  l,...,t)  and  9,  are  the  solutions  of  the 

^i        '    '  i 

equations 


c       t    a..    ^    t    a.  .       t  A^^.l 

-^  +   Z   ^+6   2    d^  "  "  ^  r^  '    (i  =  l,2,...,t)  (4.1.3) 

^i    j(;^'i)  *^  i j      j(?i)   ji     j<k   ijk 

(S) 
fi      t   a..p.       t   A.  ' 
b   e   ^   ^  _J^J_^   n   S   -iJii  (4.1.4) 

e^-1    i.j   ''ij       i<j<k  ^jk 

t 

S   p.  =  1  ,  (4.1.5) 

and  .  ,   1 

1=1 

where  A^^\    =  B  A.  .73  it.,  A^^\^    =  B  A.   /5  6,  and  d   =  p  +  Bp 
ijk      ijk     1      ijk      ijk  ij     1     J 

To  solve  this  system  of  equations,  it  is  convenient  to  write 
(4.1.3)  and  (4.1.4)  in  the  form 
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k  p. 


(i) 


Ji 


t      A.  .;  t 

^       A    .,  .  ,  ,. .    d.  . 

j<k        ijk        j(?ii)       ij 


t         a.  . 
Z       T- 


(4.1.6) 


and 


1   H    b 


1+S 


,(6) 
ijk 


tap 


.^.^.    A.  .,  ...      d.  . 

i<j<k      ijk        iT^j         ij 


(4.1.7) 


where   the   constant    k   is    eliminated    through    the  use   of    (4.1.5). 
Explicit    solutions   of    equations    (4.1.6)    and    (4. 1 . 7) are  not    possibli 
but    iterative   solutions    are.      Stai'ting  with    a   set    of    trial    values, 


^(0)    (0)   .. 
6    ,  p.     (i 


,t),an  iterative  procedure  employing  (4.1.5) 


(4.1.6)  and  (4.1.7)  will  yield  a  sequence  of  estimates,  8    ,  p." 
(i  =  1,2,...,!).   The  procedure  is  continued  until  the  process  con- 
verges to  the  accuj-acy  required. 

A  good  choice  of  starting  values  will  shorten  tlie  niimber  of 
iterations  required.   As  an  aid  in  finding  starting  values  for  the 
iteration  process,  we  have  considered  approximating  the  likelihood 

equations  by  two  equations  wlierein  A.  .,  ,  A.  .,  and  A.  .,  are  replaced 
^  ijk  '   ijk      ijk 

by  the  terms  involving  the  highest  power  of  n.if.n  .   Thus 

1  J  k 


ijk 


and 


(4.1.8) 


ijk 


Using  the  maximum  likelihood  equations  with  A.  ., /A.  .   replaced  by 

(0)  f^ 

2/p.  and  A   /A    replaced  by  6/6,  we  have  the  following  approximate 
1      ijk   ijk 

likelihood  equations; 
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2n  (*;S 


(i=l,2,... ,t) 


j(?^i)   ij     j(?^i)   ji 


and 


1  +  b 


(1+6) 


^    ,      t   a. .  p . 


(4.1.9) 


(4.1.10) 


In  equation  (4.1.10),  let  p.  =  p   (i  =  l,2,...,t);  (4.1.10)  then 
simplifies  to 


1  +  b 


1+e  L  e    ^       i+eJ 


Let  us  define  the  constant  N  by 


(4.1.11) 


(4.1.12) 


the  number  of  pairwise  comparisons  made  in  the  total  ex]Deriment  and 
therefore 


(4.1.13) 


that  is,  N,  the  total  number  of  pairwise  comparisons,  must  equal  the 
total  number  of  preferences  plus  the  number  of  ties.   Therefore, 
emiploj'ing  (4,1.12)  and  (4.1.13),  we  can  write 


i+e  L  e       1+6-1 


which  simplifies  to  the  quadratic  equation, 


(4.1.14) 


a  e  +  a  §  -  (2a+b)  =  0 


(4.1.15) 


v.'ith  solutions 


119        1/9 

2    2¥  ^^        "^  4ab)  -^   .  (4.1.16) 


Considering  only  the  positive  root,  we  have 


Vf.f-I^l.  <4.1..7, 


Henco,  we  have  an  admissible  value  of  6  as  the  solution  of 
(4.1.10)  for  p.  =  p   (i  =^  1,2,. ..,t). 


Using  the  value  of  6  found  in  (4.1.17)  as  6   ,  we  proceed 


(4.1.9).   Assume  all  tlie  p.'s  except  p.  are  equal.   This  implies  that 

1-p 
p.  =  — —   (j  ^    i,  i  ^  l,2,...,t).   Then  (4.1.9)   simplifies  to  the 

quadratic  equations  in  p.  given  as 

p^[a.   [ect-D^  -  Pa-D]   +    a  .  {§^(t-l)  -  6}  ] 
+  P.[n.   [e^(t-l)}  -  a  .  [Q^it-D    -   29}] 

-  [a  .  6]  =  0,  (3=1,... ,t),       (4.1.18) 

t 
v.'here  a.   =  a.  while  a  .  =   T,        a..,  the  number  of  times  another 

treatment  was  preferred  to  treatment  i.   If   p.  =  0,  the  value  of 
(4.1.18)  is   -a  .  9  S  0,  while  for  p.  =1,  the  value  of  the  equation  is 


e   [; 
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In  fact,  for   p.  =  0,  (4.1.18)  is  zero  iff  a  .  is  zero  and  for 

p   =1,  (4.1.18)  is  zero  iff  both  a  .  and  a.   are  zero.   Therefore, 
■^i     '  .11. 

since  for  either   a  .  ?^  0   or  a .   7^  0,  (4,1.18)  has  different  signs 
.  1  1. 

at   p.  =  0  and  p.  =  1,  it  follows  that  (4.1.18)  has  two  real  unequal 
roots,  exactly  one  of  which  lies  in  the  interval  (0,1).   We  can  use 
this  root  as  the  initial  value,  p.     (i  =  l,2,...,t),  to  be  used  with 
i    found  in  (4.1.17),  to  begin  the  iteration  procedure. 


4.2.   Tests  of  Hypotheses 

In  this  section  we  will  consider  large-sample  tests  of  three 
hypotheses  which  are  of  practical  interest. 

Test  1.   A  test  of  the  equality  of  the  true  treatment  ratings.   V.'e  are 
interested  in  testing 


against  the  alternative 


H    :    V     ?^  ^        for  some   ij^j,  l^i,  j^t. 
11     i     J 


A  large  sample  test  based  on  the  likelihood  ratio 


.-,  -,...,  K    6) 
^t'  t'    '  t' 


'       L(p,,  p^....,  P,,  e) 


is  obtained  by  using  -2  In  A^  as  a  test  statistic.   Under  H^^ ,  -  21n  A^ 
has  an  approximate  x^-distribution  with  (t-1)  degrees  of  freedom. 
Under  H   ,  from  (4.1.1)  we  have 


T    c                    b/2                  ^         a 
,       ,              ,                     (i)       (6^   -1)            [i-   (1+S   )] 
L(l     1  ...,1,    e    )    =    J: 5 1 o ^^  (4    2,) 


t'     t'  '1'        O 


t  O  O  O  o 


L(P,,    P2,...,P,.    e)    .    ^-^       '      ^ iii_^    .  (4.2.2) 

n     d.  .y 

i<j<lc       ^^^ 
By  using   the   relationships      6(    )    =    2a  +   b  =    a  +    c,    algebraic   simplifi- 


2 

cation  shows  that  for  Xi  =  -2  In  A  ,  we  have 


3 

,,-   2  1....^, 


2 

t  ,         .        ,e  -1, 


-?  =  -  {,f,  s  -'  <i^'  ^  I  -  (fc) 


t        ,1  +  0  , 
E   a.,  m  (— ^ 


•  d+e  )^  (6^  -  39^  +  96    -  1). 


o     o     o     o       1 

?x: J^' 


n    Z    m  1 "  ,  .  " i^ I  h  ,     (4.2.3) 

i<j<k 


where   6   is  the  solution  to  (4.1.7)  for   p.  =  -  (i  =  l,,..,t)  while 
o  it' 

P-,  ,  Po.-''.P^)  5   are  the  solutions  to  (4.1.6)  and  (4.1.7)  and  A. 
12       t  IJK 

is   A_   evaluated  using  P,  ,P  , .  •  •  ,P,  ,  9  . 

Test  2.   A  test  of  the  threshold  parameter,  6.   Here  we  are  interested 
in  testing  whether 

against  the  alternative 

«12  •■  ®  ^  ®o  • 


2 

A  large  sample  test  of  H   is  provided  by  the  statistic  -2  In  A  =  x 


^  = 


max  L  (it  n  ,  6  ) 

_     1'     to 


'Pt'  ®^ 


2  2 

Under  H   >   X„  h^is  an  approximate  X     distribution  with  one  degree  of 

freedom.   If  p'   p',...,p!   are  the  solutions  to  (4.1.5)  and  (4.1.6) 
with  6  =  G  ,  then 


1=1  1  D  -1 


t  d..         t       A_   ^ 

+   E   a.  .  In  (-fi)  -  n   Z        In  (t^^)  [  '  (4.2.4) 

i^j  ''  'ji      i<j<k     ^jk^ 


vliere  d'   and  A'    are  evaluated  using  p'  ,  p'  ...  ,p'  6  . 
ij       ijk  ^   1'   2'    'to 

An  hypothesis  of  interest  would  be  6  =  1 ,  i.e.,  the  Bradley- 

Pendergrass  model  is  adequate  for  the  data.   However,  the  appearance 

of  one  or  more  ties  in  the  data  is  sufficient  evidence  to  reject  the 

Bradley -Pendergrass  model,  since  the  observed  ties  would  represent  the 

occurrence  of  impossible  events  imder  the  hypothesis  that  8=1. 

Test  3.   A  test  of  the  adequacy  of  the  model.   To  test  the  adequacy  of 

the  m.odel  ,  a  large  sample  goodness  of  fit  test  can  be  employed  using 

2 

the  X  statistic.  For  eacii  distinct  triple,  let  us  define  the  follow- 
ing thirteen  cell  probabilities  corresponding  to  the  thirteen  possible 
outcomes  as 


P(i  -j  -"10  ,   P(i  -  k  -  j)  ,.  .  .  ,P(i  =  j  =  k). 
Let  p(i  -*  j  -*  k)  ,  p(i  -*  k  -^  j)  , .  .  .  ,p  (i  =  j  =  k)  be  the  sample  estimates 
found  using  p  ,  P^,...,P  ,6,  the  solutions  to  (4.1.5),  (4.1.6)  and 
(4.1.7).   For  n  replicates  of  the  (  )  triples,  the  estimated  cell  fre- 
quencies would  be  given  as 

f  (i  -  j  -^  k)  =  n  p(i  -  j  -  k) 
o 

f  (i  --  k  -  j)  =  n  p(i  -^  k  -*  j) 


f  (i  =  j  =  k)  =  n  p(i  =  j  =  k)  . 
o 

The  test  statistic  would  be 
2      ,  [f(i-j-k)  -  f^(i-j-k]^         [f(i=  j  =k)  -  f^(i=  j  =k)]^. 

f  (i  -  j  -  k)  f  (i  -  j  =  k)      -* 

o  o 

(4.2.5) 


<-^H 


t  2 

where  the  sum  is  taken  over  the  (  )  treatment  combinations.   x„  is 

2  2 

approximately  distributed  as  a  x  -variate  with  t[2t   -  6t  +  3] 

degrees  of  freedom. 
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4.3,   Combination  of  Expei'iments 

In  certain  cases,  repetitions  of  triple  comparisons  may  be 
performed  by  different  judges  in  subjective  evaluations  at  different 
times,  in  different  places  or  under  different  conditions.   In  such 

situations  the  overall  experiment  may  bo  thought  of  as  consisting  of 

th 

I 

i;   n  =  n.   The  parameters  for  the  u"""  group  can  be  taken  to  be 
u=l   ■" 

(tt  ,...,"n  ,9  )  for  u  =  l,2,..,,g.   This  assumes  that  the  merit  ratings 
1       t   u 

for  the  t  treatments  remain  constant  over  the  g  groups  and  allows  the 

threshold  parameter  to  change  from  judge  to  judge,  time  to  time,  or 

place  to  place.   Since  the  model  is  multiplicative  with  respect  to  the 

parameter  S  ,  the  model  does  allow  for  an  interaction  of  treatment 
^  u 

ratings  and  groups. 

For  g  groups  of  repetitions  of  the  (  )  triple  comparisons,  the 


likelihood  of  the  observed  sample  is  given 
L(TT  ,Tiv T^.  ,6,  ,e„,...  ,6  ) 


1'    2' 


,^    ,6    ,6    , 
'    t'    1'    2' 


n    L(^."2"-""t'V 

u=l 


n 

u=l 


t        c"-^ 

n     rr/ 
i.l      ^   • 


r       — ■ 

e^-i)^ 

I     u 


u   - 

n    D^.'^J'I 
i^j    ''     J 


n     ["A.  .1 
i<j<i.      ^^^ 


g 

n 


II    (e^-i)^"/^ 


_u=:l    :l^j      j: 


n      n     [  A     ] 

u=l    i<j<k  '-^^ 


The  maximum  likelihood  estimators  are  the  iterative  solution; 
to  the  equations 


kp.  =   E   c 
^    u=l 


g    t 
E   E  n 
u=l  j<k  "■ 


u  (i) 


g     t         ^i     ^    t    ^i 

A..^    u.l  j(^'i)   "   d".   "^^lj(^i)  °ij 


(4.3.1) 


B     =  1  +  b 
u 


t   ^.^^> 

E   -^^  -  E 


t   a. .  p. 
ij   1 


i<J<k   A^.^    i^J   D.^ 


(4.3.2) 


u  =  1,2,. . . ,g 


where  the  constant  k  is  eliminated  through  the  use  of  the  equation 


.1.  "^-^  ■ 


(4.3.3) 


As  in  (4.1.9)  and  (4.1.10),  we  can  get  starting  values  for  the  iterative 
procedure  required  to  solve  (4.3.1)  and  (4.3.2)  using  (4.3.3)  by  consider- 
ing approximate  likelihood  equations  given  as 


t-1      ^   I 
2n  (  2  )  -  ^   c' 

u=l 


KP. 

s 

E 

t 
E 

-  u 

R 

u       - 

u=i  j(7^i) 

Ld" 

u 

d"  J 

iJ 

ji 

and 


1  +  b^ 


(1+9  ) 


6n  ()  t      a..  P. 


-  E 


iy^J     ij 


i  =  1,2,. .. ,t 


u  =  1,2,.  .  .  ,s 


(4.3.4) 


(4.3.5) 


lin  eliminating  k  through  the  use  of 


E  P.  -  1 
i=l 


In  equation  (4.3.5),  let  p.  =  p  (i=l , 2, . . ,  ,  t) .   Then  (4.3.5)  simplifies 
to  the  quadratic  equation, 

a"  e^  +  a"  e   -  (2a"  +  b")  =  0  (4.3.6) 

u       u  ' 

which  has  an  admissible  solution  2:  1.   Using  the  values  of  6 
(u=l , 2, . . . ,g)  found  as  solutions  to  the  g  equations  in  (4.3.6), 
g  estimates  of  p.  can  be  found  for  each  of  the  g  groups,  by  solving 
the  g  equations 

(p")^  [a"  [§   (t-1)^  -  e^  (t-1)}  +  a  .  [9^  (t-1)  -  e    }] 
•^1      1  ^  u  u       ^  .1    u  u-' 

+  p"  [a"   {e^  (t-1)]  -  a  .  [e^  (t-1)  -  2§]]  -  [a".  9]  =0    (4.3.7) 
11.  ^u       -"     .i^u  ■'  .1 

u  -  l,2,...,g  . 

Therefore, one  can  use  as  the  initial  value  of  p.,  the  weighted  average 
of  the  p. ' s, given  as 

^  u 

p  =   S  n  p  /n  ,     (i  =  1,2,... ,t)       (4.3.8) 

'^i      ,  u  "^i    ' 
u=l 

which  will  yield  admissible  solutions,  since  each  equation  in  (4.3.7) 

th 
yields  an  admissible  solution  based  on  the  data  for  the  u   group. 

Two  tests  involving  this  model  are  of  importance  and  will  be 

considered  here. 

Test  4.   Test  of  equality  of  the  treatment  ratings.   Consider 
«04  ■■'\   =   \         <i=1.2,....t) 


versus  the  alternative 


H.  ,  :  VI.  ^  vr.   (i^^j;  1  s  i,j  <  t), 
14     :     J 


Based  on  the  likelihood  ratio 


X     ^<t---.^  \---V 


(9l.---.V 


u'h<=rr>  n"   d"   .  .  . d"  .  6  6   are  the  iterative  solutions  to  (4.3.1) 

vvneit,   P^,  Fg''  •  •  '-  t'   1  '     '  U 

2  2 

(4.3.2)  and  (4.3.3),     X  =  -  2  In  A  has  an  approximate  X  distribu- 
tion witli  (t-1)  degrees  of  freedom.   One  can  show  tliat 

x^  -  u  '\  <  -  <*^?"  ^  ^  -  (|^) 

U=l     1  =  1  o    -1 

t         ,1+B  . 
+  S   a.  .  In  ( ) 


1.,   " 


■(1  +  0   )^  (0^  -36^  +99   -1)-.  . 


r-u  +  p  )      Kv     --^^     -t-^y  ""-^-'■1  1 

ou      ou    ou    ou      I 


n   Z   In   ~ ^ — ~ f,  (4.3.9) 


i<J<k    -         t   A..^^ 

1         1 

where  6    is  the  solution  to  (4.3.2)  using  the  values  it   =  -,...,'",= -r 
ou  1    t      t   t 

and  A    is  evaluated  using  the  values  p'',...,p'',  6^  , .  .  .  ,  S  . 
ijk  1      t    1      g 


Test  5.   A  test  of  equality  of  the  threshold  parameters  in  the  different 
groups.   V\'e  now  test 


H    :  6   =0     (u  =  1,2, . . . ,g)  for  some 
05    u 


rainst    the   alternative 


H        :    6     7^    6    ,         for   some  u  7^   u' 
15  u  u' 


The  likelihood  ratio  test  will  provide  the  test  statistic  given  as 

2  2 

X  =  -  2  In  A  .  which  is  approximately  distributed  as  a  x  with  (g-1) 
5  5 

degrees  of  freedom  for  large  samples.   Now 

max  L   (tt^  .if^.  •  •  •  ."^  >  6  ) 
„         12       to 


where  p"  p'^,...,p'',  6   6  ,...,§   are  the  solutions  of  (4.3.1),  (4.3.2) 

and  (4.3.3).   Denoting  the  maximizing  values  of  if  ,  "„,..., tt   in 

L(''°f,  >■'"'  i-'->''^  >  ^  ^    as  p  ,p  ,...,p  ,  i.e.,  the  solutions  to  (4. 3. 1)  and 

(4.3.3)  for  ^   =  6  ,  it  is  easilj^  seen  that 
"     o 

I   t    g 


x^2 


I  i=i  u=i  ^   ^^J    u.i     ^e^-i^ 

L  o 

.-E  S   a",  m  f-li)  -  Z    Z   n  -^^^\ 


(4.3.10) 


We  note  tliat  all  of  the  preceding  methods  and  results  can  be 

adapted  to  the  case  of  unequal  repetitions  of  the  treatment  triples 

with  slight  modifications,  e.g.,  replacing  n  with   S   ^--i,  -'■^^ 

i<j<k  ^^"^ 

r     the  number  of  repetitions  of  the  treatment  triple  (i,J,K). 


CHAPTER  5 


LARGE  SA]\CPLE  PROPERTIES  OF 
ESTIMATORS  AND  TESTS 


5.1.   The  Limiting  Distribution  of  the 
Maximum  Likelihood  Estimators 


Under  general  conditions  (see  for  example  Wilks  [28]  or 

Chanda  [5])  which  can  be  verified  for  our  problem,  p  , ...,p  ,  S  are 

t 

consistent  estimators  of  'ff  ,Vf    .  .  ,vt  ,  9,  and,  considering  it   =  1  -  En. 

ir;l 

ijr\    (G-9),  v^  (p  -"^  )  ,  .  ,  .  ,«yn  (p   ,  -  ''^^.  -,  )  have  an  asymptotic  t-variate 
normal  distribution  witli  zero  means  and  dispersion  matrix  (X   ) 
(0  s  i,j  <  t-1)  v.here 


ij 


d   In  f(n,e) 


dn .  Sn  . 


(1  S  i,j  ^   t-1) 


X    -  E 

CO 


B  In  f  (IT,  6) 


B  0' 


(5.1.1) 


5   In  f  (IT,  6) 

se  SiT. 


(j  =  1,2,.  .,  ,t-l) 


and  f(iT,9)  is  the  likelihood  function  for  the  r   repetition  of  the 


experiment.   To  facilitate  finding  the  elements  of  (\    .),  define 


a.  .^    =   E(a.  .    1 
ijk  ijk 


n     n.    D..    D    .    D,  .        rr^  n,     D,  .    D .  .    D .,         n^  17      D        D        D 

1      J      ji      ki      kj           1  k      ki      ji      jk          k      i      ik     jk      ji 

A.  .,  A.  .,                     ^                 A.  ., 

ijk  ijk                                          ijk 

TT^  Tf.   n,    D..    D    .    (6^-1)  nf  n^  D    .    D        (6^-1) 

1      J      k      ji      ki k      1      ji      ki 

"^                         A.  .,  ^                      A.  ., 

ijk  ijk 


E[b.  .,  ] 
ijk 

v^  n^  D       D,  .    (6^-1)        n^  n     TT     D        D        (9^-1) 
_i j      ki      kj k      i      j      ik      jk 

A.  .,  A.  ., 

ijk  ijk 

n^  n'  rif   <e=^-l)^ 

^^-^^ 

ijk 


and 


Vijk  -   ^f^ijk^ 


^  .,     +   b.  .,] 
ijk  ijk 


ijk  ijk 


(5.1.2) 


To   avoid   fui'ther    confusion  with    subscripts,    let   us   write   the   log   of 
the   likelihood   function    for   the   r        replicate    as 


In   f(TT,e)    =   -  In    (8^-1)    +      Z      c.    In  n.    +      S      a.  .    In   D.. 
'  i=l      ^  ^        i^j      ''  '' 

t 


T.        In  A.  .,     .  (5.1.3) 

i<j<k  ^'^ 


Let   D     represent    the  differential    operator   with   respect    to  Ti 
(V  =   1,2, ... ,t).      Then 


^vv  =   Ef-  \   ^"  ^^'''^^^ 


^.        S        ^.e2         J        !^i.      S      B^^";'Nv.l,2,...,t),  (5.1.4) 


foi 


(vv)    ^      vjk     vjk  vjk     vjk 


A^^^    .    D    (A        )       and      A^^^^    =    D^A    .,) 
vjk  V     Vjk  Vjk  V     Vjk 


For  1)      ,    the   differential    operator   with   respect    to  n      and  rr    ,    we  have 
v^l'  V  [l' 

for   the  pair    ([i,v)     ((i^v;    1   S    ^i,v   =    t)  , 


X        =   E[-  D        In   f(iT,e)] 


I  a  a 

I       |iV  V  \x 

i     2  "*"   ~2~ 

D  D 

1-   V|I  pv- 


t       (V^l) 
+   S   B      , 

k.i  ^^^ 


(5.1.5) 


(V(j,)   _     V  p.k     V  [}k V  [.ik     V  [ik 

vpk     "  '     tA     ,  ]2 

V(ik 


for 


A^7^    =    D         (A      ,), 
V  p,k  V  p,        V  pLk 


In   an   analogous   mannei-,  we   find   that 


\        =   E[-  D.    In   f(n,e)] 
oo  b 


(6^-1)' 


•oP     4        5] 


2 

t     n     a 
1      ij 


2         -         ^         -^?^ 


(5.1.6) 


^oV=    ^f-%    1"^^"'^)^ 


i(?^v) 


L     ^i 


D..,l        J<k 


(5.1.7) 


On  differentiating  In  f("T,6)  under  the  restriction  17  =  1  -  Z  ft  , 

'       i.l  ' 
we  find  lliat 


^v^i  -  \\x  "   \t  ~  ^nt  "*"  ^tt 


X   =  X 
oo    oo 


(5.1.8) 


X   =  X   -  X  , 
ov    ov    ot 


(1  ^  \i,\>  ^   t-1), 


It  follov.-s  that  v^  (9  -  6),  v^  (p^  -  17^),,..,^/^  (p^  -  if^) 
have  asymptotically  a  (t+1) -variate  singular  normal  distribution  of 
rank  t  with  zero  means  and  dispersion  matrix  I!  =    (o.  .),  where 


Z  = 


(5.1.9) 


(ff 


o ,  t '  "  1 ,  t 


t-1 

Y.     O.  (i  =  0,1,2,..,  ,t-l) 

u=l 


and 


tt  uv 

u=l   v=l 


5.2.   An  Approximation  for  T,   in  the  Cast 
of  Equal  Treatment  Ratings 


If  P-,  ,  Pr,.-»')P^  ^^"^   approximately  equal,  estimates  of  a.  .  may 

be  obtained  by  taking  r.      -    ...  =  n   =  — .   Let 

^,.,  3(1+6)^  +  4(1+G)^  (6^-1)  +  (G^-l)^ 

BCG)  .  3(1  +  6)-^  +  2(1+6)^  (6^-1) 


C(6)  .  '^6(e^i)(3S^39.i)  _2 


DCG)  .  2(G+l)(G'^-e\9\llG^6e-l)  _  2 


0  =  (1+G)^  (6^-36^+90-1) 


e-.t-^A^^f)       1 


(5.2.1) 


Now,    when  it.    =—  (i   =   l,...,t), 

'  it 

where 

n2 


X^(9,t)    =    t^(t-l)(t-2)A(e)    +    t^(t-l)(t-2)|     """    ^  I   BCD) 


L(i+( 


^    tVt-mt-2l,.S),  (5.2.2) 


and 


V   =    ^2^^'^^ 


X    (e,t)    =    t^(t-2)    I— -^^1   BCS)    +    t^(t-2)    D(G)    .  (5.2.3) 

^  L(i+e)^J 


^v  =  \v   -  2X,,  -^  X^,    , 


we   can   write 


X^^   =    2[X^(e,t)    -   X2(6,t)]    .  (5.2.4) 


In  the   case  v   ^    [i,    we  have 


X        =   X        -  X   ,   -  \,    +  A^^    , 

|iV  p,V  (it  vt  tt 

which    can   be  written    as 

X*    =  [X  re,t)  -  x^(9,t)]  .  (5.2.5) 

p.v  1  2 

Let   us    define      X(9,t)    by 

x(e,t)  =  x_^(e,t)  -  x^(e,t)  .  (5.2.6) 
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From  (5,2.4),  (5.2.5)  and  (5.2.6),  we  see  that 

X*     =   2\*     =  2X(e,t)  (5.2.7) 

W      |j,v 

for     H  ?^'  V,    1  ^  ^i,v  <  t-1  . 

The   exiDression   for    (5.  2.  5)    can  be  written   as 


X(e,t)    =    t^(t-l)(t-2)A(G)    +    t^(t-l)(t-2)    M-^      B(0) 

L(l+6)    -' 


t^t-l)(t-2)    ^^,^    _^2^^_^^    1-^^JB(8) 


Ui+6)^J 


-   t^(t-2)    D(G)     .  (5.2.S) 


(Expression  (5.2.8)  will  be  used  in  the  investigation  of  power  and 
asymptotic  relative  efficiency  in  Sections  5.3  and  5.4.) 
We  also  find  that 


X   =  X 
oo    oo 


^-^^'-^  ril^  ^(e)  .  _A_-  B(e)  .  G(e)}       (5.2.9) 
•      ^  \e^-i)2  (i+G)''  ^ 


X   =  X   -  X  , 
ov    ov    ot 


(V  =  1,2,. .. ,t-l)  .  (5.2.10) 


Then  the  approximated  dispersion  matrix  of  the  random  variables 

•Jn    (6-9),  >/n    (p   -v   )  , .  .  .  ,^/n    (p  -n  ),when  n  ,  'n  ,...,",_,  and  n   are 

approximately  equal  to  1/t, is  given  as  S,  whose  elements  are 


*  -1 
e   =  [X  ] 
oo     oo 

a   =   a       =   0  (i  =  1,2,.  .  .  ,t) , 

oi     io 

a..  =  -^^^  [X(e,t)]"^      (i  -  l,2,...,t) 
XI       t 

and 

0.  .  =  -  r  [X(0,t)]""^      ii^j;    1  <  i,j  S  t)  .  (5.2.11) 

When   6=1,  the  model  reduces  to  that  of  Bradley  and  Pendergrass  and 

1 


o.  .  =  -3[t''(t-2)]  -""     (iy^j;  1  s  i,j  =?  t) 


and 


o..  =  3(t-l)[t^(t-2)]  -^      (i  =  1,2,. ..,t).  (5.2.12) 


5.3.   A  Comparison  of  the  Powers  of  Tests 

The  investigation  of  the  power  of  a  statistical  test  serves  as 
a  means  of  assessing  the  merits  of  the  test  in  contrast  to  alternate 
procedures.   Some  important  alternatives  to  the  method  of  triple  com- 
parisons with  ties  are  (1)  the  method  of  triple  comparisons  without 
ties,  (2)  the  analysis  of  variance  run  in  com.plete  blocks  and  (3)  the 
analysis  of  variance  run  in  balanced  incomplete  blocks  of  size  three. 

The  correspondence  between  the  parameters  of  the  method  of 
paired  comparisons  and  those  of  analysis  of  variance  have  been 
established  by  Bradley  tU  by  referring  to  the  Thurstone-Mosteller 
model,  given  as 


p[x.  -  X.]  =  J-     r 

■J    V2Tr  -(s.-S.)/ 


1  2 

2  y 

2     dy  ,  (5.3,1) 


V2n  -(S.-S.)/a^ 

where  S.  is  the  location  point  for  the  variate  X.  on  a  subjective 

2 

continuum  and  c    is  the  variance  of  the  difference  (X.-X.).   Under 
d  1   J 

2  2  2 

the   analysis   of   variance   assumption   that     p    =   0 ,    o      =    2a  ,  where      a 

is   the   common  variance   of   X.    and   X..      Hence,    the  Thurstone-Mosteller 

model    may   be   associated  with    an   analysis   of   vai'iance  model   having   the 

2 

same  v-ariance,  a  ,  for  the  random  element  of  its  additive  model  and 

witli  S   rs  the  effect  of  treatment  i. 
i 

In  this  same  paper,  Bradley  has  shown  that  in  comparing  (5.3.1) 
with  the  Bradley-Terry  model  for  paired  comparisons  given  as 


P[X.  -X.]  =  -^         f        sech^  (t^-)  dy  ,  (5.3.2) 

^    J    ^'-^   -adnn.-mn.)       ^a 
1     J 


the  form  of  the  integrand  does  not  matter  for  large  stunple  sizes. 
In  fact,  for 


P[X.  -X.]  =  J  f(y)  dy  , 


the  variance  of  an  estimate,  c,  of  c  obtained  from  an  estimate,  p,  of 

P[X.  -*X.]  does  not  depend  upon  the  form  of  f  (y)  ,  but  only  upon  the 

ordinate  f(-c).   Accordingly,  Bradley  has  established  the  correspondence 

between  S.  and  it   to  be 
1      i 

S.  =  .Jvjl   In  17.  (5.3.3) 


by  taking  the  scale  factor  in  (5.3.2)  to  be  ^/^7^,   so  that  f  ( 0)  =  1/^21? 

for  each  model.   The  value  y  =  0   has  been  chosen  because  we  wish  to 

consider  the  test  H   :  i^.  =  —  versus  the  alternative  hypothesis 
o    it 

(i  =  1,2,... ,t)  ,  (5.3.4) 


1           in' 

1, 

:     TT.      : 

=  r  +  

1 

1 

*       ^ 

where  n'  is  the  number  of  complete  repetitions  of  the  pairwise  exjoeri- 
ment  and    lim  6!  ,  =6'.;  therefore,  (In  I'f .  -  In  rr.)  is  of  order  1/Vn 

n'  -•CO 

Since  the  correspondence  of  the  parameters  of  the  method  of 

analysis  of  variance  has  been  established  for  pairwise  comparisons, 

we  need  an  association  of  the  5'.  ,  of  pairwise  comparisons  with  the 

6    of  trinle  comparisons.   To  obtain  the  required  association,  we  note 
in 

that  for  paired  comparisons  with  ties 


P[X  -  X.]  =  17. /(n.  +  et7.)  .  (5.3.5) 

1     J      11     J 

For     n      =   -  +    6'     ,  A/i?"   ,     (5.3.5)    can  be   expressed   as 
it  in 


p[x.  -  X.] .  -i^ .  -^  (!k_:^) ,  0  (L-) 

^    '         ^^^        (1+9)^  ^    v^    ^ 


(5.3.6) 


From  the  probability  model  for  triple  comparisons  with  ties, 
we  find 

P[X.  -^  X.]  =  P[X.  -^  X.  -^  XJ  .   P[X.  -.  X^  -  X.] 

.P[X^-.X^-X.]  .P[X^-X.  .x^] 

+  P[X  =  X.  -  X.]  .  (5.3.7) 

k     1     J 
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Therefore, 

■1       r    2   .,      ^         ^         ^  2 


P[X. 


-^  X   ]    =   A.  .,     [ff      n.    D.  .    D,  .    D,   .    +   n.    n     D,  .    D..    D., 
1  J  ijk        1      J      ji      ki      kj  1      k      ki      ji      jk 

+  n^  n.    D.,    D.,    D..    +  n^  n.    n     D .  .  D,  .(6^-1) 
k      1      ik     jk      ji  1      J      k     ji    ki 

+  17^  nf  D..D.,  (G^-l)]    ,  r^   -,    ^^ 

1      k     ji   jl^  (5.3,  8) 

which,    under   the   alternate  hypothesis, 

,         6. 
K      :    rr     =   i  +   -221   ,  (5.3.9) 

1  i         t  r- 

Vn 

where  n   is   the  number   of    complete  repetitions   of    the   experiment    and 
lim  6.      =6.    can   be  written    as 


T,rv     _   V   T  1    +    29  e(l  +  3e)t ^^in^jn^ 

i^  L  A .     •"•     A.J      -     — —    + ~     • 

^       "^       6+6(i-8)+(i-6)       (i+e)[6+6(i-e)+(i-0)  ]  J7\ 

+    O(-)    .  (5.3.10) 

n 

It  is  helpful  to  thinlc  of  (5.3.6)  and  (5.3,10)  in  the  following  way. 
Consider 

P[X.    -   X.     I    IT   =    TT      +   -i-   6]    ==    P[X.    -   X.     I    IT   =    IT    ] 
1  J     '  o        ^  X  J     ' 


+    {PLX.    -  X.    I    IT  =  n     +  —  6] 


-   P[X.    -  X.    I    n  =   IT   ]]    .  (5,3.11) 

This  is  to  say  that  the  first  quantity  represents  the  probability  that 
i  is  preferred  to  j  under  the  null  hypothesis,  while  the  second  quantity 
represents  the  contribution  due  to  t}ie  fact  that  the  alternate  hypothesis 
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is  true.   In  order  to  establish  the  correspondence  between  6'.  ,  and 

m 

6   ,  we  shall  require  that  the  rates  of  convergence  to  the  null  val\ie, 
in 

rt  ,  be  the  same  for  equal  values  of  n.   In  other  words,  we  require  that 
o 

6t    ^^In'-^jn'^  ^        e(l  +  3e)t       ^^n-^jn^  ^        ^^^  3^  ^^^ 

(1+6)^         ^         (i+e)[6+6(i-e)+(i-e)^]       ^ 

which  implies  that  for   n  =  n' 

6    -  [6  +  6(1-6)  +  (1-9)^]  ,, 
in  ~       (1+0)  (1+30)        in 

=  g(e)  6;  ,  say  .  (5.3.13) 

We  now  proceed  to  investigate  the  power  of  the  likelihood  ratio 
test,  using  the  triple  comparison  model  with  ties  as  compared  to  the 
Bradley-Pendcrgrass  model  and  tlie  two  analysis  of  variance  models. 

Under  mild  regularity  conditions,  similar  to  those  required 

for  maximum  likelihood  estimation  which  hold  for  our  problem,  V.'ald  [27] 

6 
1         „         1     in 

has  shown  that  in  testing   H   :  n.  =  -  versus   H   :  n.  =  -  +  

(i  =  l,2,...,t),  the  likelihood  ratio  statistic,  -  2  log  A^ ,  given  in 

2 

(4.2.3),  is  asymptotically  distributed  as  a  central  X  variate  with 

(t-1)  degrees  of  freedom  wlien  H   is  true.   When  H   is  true,  -  2  log  A^ 
has  an  asymptotic  x  distribution  with  (t-1)  degrees  of  freedom   and 
non-centrality  parameter  given  as 

1  *    2 

i=l 

for  /V(6,t)  defined  in  (5.2.  S).   Hence,  the  asymptotic  power  for  a 
size  O'  test  is  given  by 


2  2 

where  x    (&)  is  the  o-level  significance  value  of  a  central  x 

distribution  with  (t-1)  degrees  of  freedom  and  f(t;cp)  is  the  non- 

2 

central  X  distribution  with  (t-1)  degrees  of  freedom  and  non-central ity 

parameter  cp.   P.  C.  Tang  [23]  has  provided  tables  for  evaluating  the 
integral 


Kcp;a)  =  J   f  (F'  ;p,q,cp)  dF' 
F 


for  f(F';p,q,9)  the  density  of  a  non-central  F  variate  with  p  and  q 
degrees  of  freedom  and  non-ccntrality  parameter  cp.   By  taking   q  ^  =°, 
these  tables  can  be  used  to  evaluate  (5.3.13). 

In  investigating  the  asymptotic  power  functions  of  analysis  of 
variance  models  for  (1)  a  randomized  block  design  wit]i  block  size  t 

and  (2)  a  balanced  incomplete  block  design  with  block  size  three,  we 

2 
note  that  when  o  is  known,  the  test  statistic  in  each  case  is  x''  with 

(t-1)  degrees  of  freedom  and  non-centrality  parameters 


S   6 
i=l   ^ 


TT  t^(t-2)   ^   -2 


E   6  ,  (5.3.14) 


respectively.      For   triple    comparisons   wj th   ties,    the  non-central: ty 

2 

parameter  of  the  asymptotic  x  distribution  with  (t-1)  degrees  of 

freedom  is  given  as 
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t     2 

cp   =  xce.t)    z   6:    .  (5.3.15) 

^  i=i    ^ 

UsinK  the  correspondence  between  6   and  6'  established  in  (5.3.12), 

1      i 

we  can  write  (5.3,15)  as 

2      *    2 

cp.,  =  X(e,t)  g''(e)   E  6^  .  (5.3.16) 

^  i=l    ^ 

Under  the  analysis  of  variance  models  as  well  as  the  Bradley-Pendergrass 
model,  the  probability  of  observing  one  or  more  ties  is  zero.   This  is 
equivalent  to  evaluating  the  generalized  Bradley-Pendergrass  model  at 
G  =  1,  since  the  probability  of  one  or  more  ties  becomes  zero  and  the 
model  reduces  to  the  untied  Bradley-Pendergrass  model.   Hence,  when 
9=1,  (5.3.16)  gives  the  non-centrality  parameter  for  the  Bradley- 
Pendergrass  model  which  is 

1=1 

3        t 
=   ^^    ^^"^^   E   6^  .  (5.3.17) 

''  i=l  ' 

To  plot  the  power  functions  for  these  tests,  we  computed 

cp!  =  (cf./t)      in  order  to  use  Tang's  tables.   The  power  curves  for 

the  analysis  of  variance  F  tests  differed  slightly  for  four  treatments 

and  blocks  of  size  three,  with  the  power  of  the  F  for  complete  blocks 

being  higher  than  that  for  incomplete  blocks  of  size  three.  Hence,  the 

asymptotic  power  functions  for  the  triple  comparison  test  with  ties 

and  that  for  the  analysis  of  variance  F  test  for  balanced  incomplete 


blocks  of  size  three  have  been  plotted  and  are  given  in  Figures  1, 
2  and  3,   These  pov.er  functions  arise  in  testing  the  equality  of 
treatment  ratings. 

In  Figures  1  and  2  we  have  plotted  the  power,  P,  against 

t    2 

A  =  T.      6.  for  t  =  4  and  0,05  and  0.01  levels  of  significance, 

i  =  l   1 
respectively.   The  B-scale  is  logaritliniic  and  the  power  curves  were 

computed  by  \ising  Tang's  tables.   Figures  1  and  2  each  exliibit  the 

power  curve  for  tlie  triple  comparison  test  evaluated  at  9  =  1  in 

order  that  this  curve  can  be  compared  with  tlie  F  test  for  balanced 

incomplete  blocks  at  equal  values  of  A.   V»hen  A  =  0,  3  =  0.05  or  0.01 

and,  as  A  -•  co^  g  -.  ]  for  both  tests.   However,  the  F  test  is  more 

powerful  than  the  triple  comparison  test  for  all  values  of  A. 

Recall  that  in  the  o:'iginal  discrimination  scheme,  a  judge 
declared  a  tie  if  |y.-y.|  *^  "H  for  log  9  =  Tj.   Then  values  of  9  used 
in  Figure  3,  namely,  9  =  1,  3,  4  and  10,  correspond  to  values  of  T] 
given  as  T\   =  0,  1.10,  1.39  and  2.30,  respectively. 

In  Figure  3  the  power  curves  for  T  evaluated  at  6  =  1,  3,  4 
and  10,  as  well  as  the  curve  for  F,  are  given.   In  plotting  p  against 
A,  it  appears  that  the  triple  comparison  test  is  more  powerful  than 
the  analysis  of  variance  F  test  for  the  same  value  of  A.   However, 
it  is  impoi'tant  to  note  that  the  non-centrality  parameter  for  the  F 
test  is  given  as 


^2   4    3       ' 
while  the  non-centrality  parameter  for  the  triple  comparison  test  with 
ties  is  given  as 
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which,  when  evaluated  at  9  =  1 ,  becomes 


3t^(t-2)  ^ 


3|e.i      16 


By  allowing  6  to  assume  values  greater  than  one,  we  have  actually 


?  1     and  given  by 

-^'e^i 

A-  =  l^MM)^!iii  A  .  (5.3.18) 


In  comparing  the  power  of  two  tests  for  testing  II   "  "•  ~  7 
,    6 . 
(i  =  1      t)  ver'^us  I!   :  i"'   =  —  +  ~^—   ,    one  does  require  that  the 
' '  ■  ■  '  o     i    t    /- 

A/n 

comparison  be  made  for  equal  alternatives.   Therefore,  when  plotting 
against  A  for  values  of  6  greater  than  one,  as  in  Figure  3,  we  are 
comparing  the  power  curves  at  points  along  the  A  axis  that  are  not 
equivalent.   However,  when  P  is  plotted  against  A' ,  the  power  curves 
for  7(6)  obtained  using  the  values  6  = 3,  4  and  10  are  identical  to 
the  power  curve  given  for  T(0)  evaluated  at  G  =  1. 


5.4.   Asj^mptotic  Relative  Efficiencies 

The  theorems  of  Pitman  and  Noether  [17]  yield  asymptotic 

efficiences  in  terms  of  the  efficacies  of  the  tests  being  compared. 

For  a  statistic  T  ,  based  on  a  samole  of  size  n,  define 
n 

E[T  ]  =  Y   (A;T  )  and   Var  [T  ]  =  e^(/i;T  ). 
n     n     n  n     n    n 

The   efficacy   of    the   test   H      :    A  =    /i      against    the   alternative 
o  o 

H,     :    A  >   A      is 
1  o 

R^/'"^    (A    ;T    )    =:   ry^"^\A    ;T   )/e    (A    ;T   )1       '"     ,  (5.4.1) 

n  on  [_n  onnon'  ' 

whei"e   A     =    A     +   k/'n      foa-   6   >  0    and   m   the  order   of    the   last   non-zero 
n  o 

derivative   of   V    (A:T    )    with    respect    to   A. 
n  n 

For   our  problem  we  have   four   tests   of    the  hypothesis 

6. 

H      :    TT.    =   -     versus      H,     :    tt     =   -  +   — ^    ,  (5.4.2) 

O  1  t  1  1  t  r- 


6.      --   6.    as  n  -  «  (i   =    1 , 2, .  .  .  ,  t)    . 

m  1 

The  statistics  under  comparison  will  be  designated  as  T   for  the 

method  of  triple  comparisons  with  ties,  T'  for  the  method  of  triple 

comparisons  with  no  ties,  F   for  the  analysis  of  variance  with 

complete  blocks  and  F'  for  the  analysis  of  variance  with  balanced 
n 

2 
incomplete  blocks,  all  of  which  have  asymptotic  non-central  v  - 

distributions  with  (t-1)  degrees  of  freedom  and  non-centrality 

parameters 


and 


t  6! 

lim  n  X(e,t)   Z  — 

i=l  "^ 

t     6 


t^(t-2) 


,  2 


i=l 


rr  t^(t-l)(t-2)  I        i 

lim   n  -  — h     — 

4       2       -  T  n 


Pp.  =  i>"  "  J  — 5— 

n   n  -*'^ 


2 

Taking  A  =   E   6  /n,  the  null  hypothesis  is  true  when 

i-1   '  1 

Corresponclint;  to  Y  (A;T  )  in  (5.4.1),  we  may  take 
n    n 


(5.4.3) 


A  =  0. 


Y    (A;T  )  =  (t-1)  +  n  X(6,t)  g^(e)  A 


and 


Y  (A;T')  =  (t-1)  +  n  --^^-   (^)^  A  , 
n    n  3     4 

Y  (A;F)  .  (t-1)  .n^^'^^-V^^-^^A 
n     n  4       2 


Y  (A;F')  =  (t-1)  ,n'l'-^--^^   . 
n    n  4    3 

Differentiation  with  respect  to  A  yields  (for  all  values  of  A, 

including  A  =  0) 


(5.4.4) 


The  values  of  Yj^  and  Q^   used  here  are  not  the  means  and 
variances  of  the  statistics  for  finite  n,  but  rather  were  calculated 
from  the  limiting  distribiitions.   Noether  has  noted  that  this  is 
permissible  under  conditions  which  can  be  verified  hei'e. 
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y'(0;T  )  =  n  X(e,t)  g  (8) , 
n    n 


Y' (0;T') 
n    n 


3n  t  (t-2) 


r(0;F)  .  ,^t  (t-l)(t-2) 
n    n      4       2 


and 


n    n      4    3 


(5.4.5) 


From  the  non-central  x   distribution  with  (t-1)  degrees  of  freedom, 


o^(0;T  )  =  a^(0;T')  =  o^(0;F  )  =  0^(O;v^)  =  2(t-l) 
n    n     n    n     n    n     n 


(5.4.6) 


The  efficacies  of  the  four  tests  for  m  =  1  and  6=1  are 


R  (0;T  ) 
n    n 


X(G,t)  g^(e) 
V2(t-1) 


R  (0;T')  = 


3n  t  (t-2) 716 

y2(t-iy 


R  (0;F  )  = 


nn  t  (t-1) (t-2)/S 

A/2(t-l) 


R  (0;F')  = 


nn.t  (t-2)/12 
V2(t-1) 


(5.4.7) 


The  relative  efficiencies  of  these  tests  are  given  by  the  limits  of 
the  ratios  of  corresponding  values  of  R  .   Hence,  the  relative  effi- 


ciencies of  interest  are  given  as 


H.E.(Ttcr,=i-^H%«j!(S). 
3t  (t-2) 


B...(T.oF)     «-<e.«/(S) 


and 


TTt^(t-l)(t-2) 


12\(9,t)  g^(e) 


R.E. (T  to  F')  =  -^  '  '  '  ^  ' ^  .  (5.4.8) 

TTt  (t-2) 

Table  5,4.1  gives  the  asymptotic  relative  efficiencies  of  the 
triple  comparison  test  with  ties  to  the  triple  comparison  test  without 
ties,  the  F  test  for  complete  blocks  and  the  F'  test  for  incomplete 
blocks  of  size  3  for  t  =  3, 4, .,.,10  and  G  =  1,  3,  4  and  10.   The 
asymptotic  relative  efficiencies  for  9  >  1  exliibit  the  sam.e  pattern 
displayed  in  Figure  3,  namely,  increasing  efficiency  foi-  large  values 

of  G.   As  mentioned  in  Section  5.3,  these  comparisons  were  made  for 

^    2 

equal  values  of   A  =   Z   6..   Using  a  rescaling  technique  similar  to 

i=l   ^ 

that  given  by  (5.3.17),  we  find  that  the  resulting  asymptotic  relative 

efficiencies  are  those  given  in  Table  5.4.1  for  9=1. 

For  testing   H   :  n.  =  1/t  versus  H   :  17.  =  1/t  +  (6.  )/(v^) 
o    1  1    1  m 

with  both  analysis  of  variance  and  triple  comparison  techniques,  we 
developed  expressions  for  the  probability  that  treatment  i  was  pre- 
ferred to  j  as  functions  of  t,  6,  6.   and  n  for  both  paired  and  triple 
comparisons.   In  order  to  relate  back  to  the  analysis  of  variance 
model,  a  correspondence  between  the  6.  ' s  of  the  paired  and  triple 
comparisons  was  required.   We  established  this  coi'respondence  by 
adjusting  the  rates  of  convergence  under  H  ,  vt.  =  1/t  +  (6.  ) / {ijn)  , 
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TABLE  5.4.1 
ASYMPTOTIC  RELATIVE  EFFICIENCIES 


t 

3 

4 

5 

6 

7 

8 

9 

10 

e  = 

1 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1,00 

(T  to 

T') 

1.00 

(T  to 

F) 

0,72 

0.64 

0.60 

0.57 

0,56 

0.55 

0,  54 

0,53 

(T  to 

F') 

0.72 

0.72 

0.72 

0.72 

0,72 

0.72 

0,72 

0.72 

e  = 

3 

0.  28 

0.28 

0.28 

0.  28 

0,28 

0.28 

0.28 

(T  to 

T') 

0,28 

(T  to 

F) 

0.20 

0.18 

0.17 

0.16 

0,16 

0.15 

0.15 

0.15 

(T  to 

F') 

0.20 

0.20 

0.20 

0.20 

0.20 

0.20 

0,20 

0.20 

G  = 

4 

(T  to 

T') 

0.63 

0.63 

0.  63 

0,63 

0.63 

0.63 

0,63 

0.63 

(T  to 

F) 

0.45 

0.40 

0.37 

0,36 

0.35 

0,34 

0,34 

0.33 

(T  to 

F' 

0.45 

0.45 

0.45 

0,45 

0.45 

0,45 

0,45 

0.45 

e  = 

5 

0.92 

0.92 

0.92 

0,92 

0.92 

0,92 

0,92 

(T  to 

T') 

0.92 

(T  to 

F) 

0.66 

0.59 

0.55 

0,53 

0.51 

0,50 

0.49 

0,49 

(T  to 

E') 

0.66 

0.60 

0.66 

0,66 

0.66 

0,66 

0.66 

0,66 

e   =: 

10 

(T  to 

T') 

1.80 

1.80 

1,80 

1,80 

1.  SO 

1.80 

1.80 

1.80 

(T  to 

F) 

1.29 

1.  14 

1.07 

1.03 

1,00 

0.98 

0.97 

0.95 

(T  to 

F') 

1.29 

1.29 

1,29 

1,29 

1.29 

1.29 

1.29 

1,29 

to   the  null   value   given  under  H    ,    n.    =    1/t,    (i   ~    l,...,t)    in   such    a 

o'   1 

way  that  we  were  at  equal  distances  from  the  hypotliesized  value  for 
PrX  -•  X  ]  under  H  .   Had  a  different  criterion  been  used  in  adjusting 
these  rates  of  convergence,  slightly  different  power  curves  and  asymp- 
totic relative  efficiencies  might  result.   However,  when  9=1,  our 
adjustment  factor,  g(0) ,  and  the  expressions  for  P[X.  -'  X.]  are  those 
given  by  Pendergrass  [19]. 


5.5.   A  Numerical  Example 

We  now  illustrate  the  use  of  the  proposed  generalized  Bradley- 

Pendergrass  model  using  computei'-simulated  data.   The  generated  data 

represent  data  collected  for  a  triple  comparison  experiment  with  ties 

for  five  treatments,  where  there  are  fifty  replications  of  each  of  ten 

distinct  treatment  triples.   The  values  of  the  treatment  ratings  were 

chosen  to  be  if   =  0.06666G7,  n   =  0.1333333,  n   =  0.2000000, 

TT,  =  0.26686G7  and  rr  =   0.3333333,  while  the  value  of  the  threshold 
4  5 

parameter  was  cliosen  as  6  =  1.5,   The  data  generated  using  these  values 
in  the  model  are  presented  in  Table  5.5.1.   For  each  of  the  ten  pos- 
sible triples, there  are  thirteen  cells.   To  facilitate  the  presentation 
of  the  cell  counts,  let  us  define  the  following  notation.   For  the 
triple  (i,j,k)  where  i  <  j  <  k,  the  cell  numbers  one  through  thirteen 
correspond  to  the  outcomes: 
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o      o      t^     ^ 


•-I        iH         t^ 


COOCOOMiOO  o 


C'^rHfOtDOfO'^O 


C0t>cg,-ICQCMOC^LOO<MCOO 


X       .-(       o 


(MrHtDCOOCMiOO 


OOCOi-lC>^INOCO^OIN^O 


CCt^t^M(Mr-IMC0C0OMt3O 


CjOOOOv'rH(NCMLO'<J'OCMLOO 


c^ocoocorHCOcqinocvi'^jfo 


Ci       LO       O       .-I       IM       OJ       O       LO       0-3       O       <N       LO       O 


OC0t-OINr-lCSlf0iOO(NlioO 


cDt-cocnoMC^co 


1.  j-^k-^i  7,  i^^j-^k 

2.  k-j-^i  8.  i  =  k-j 

3.  k'^i-'j  9.  j  =  k-i 

4.  i-^k-j  10.  i'-j  =  k 

5.  j-^i-k  11.  j->i  =  k 

6.  i-j-k  12,  k-^ir=j 
13.  i  =  j  r=  k  .   -        (5.5.1) 

il  values  for  B  and  p  ,...,P  , 
using  equations  (4.1.15)  and  (4.1.18),  equations  (4.1.16)  and  (4.1.17) 
were  used  to  obtain  the  maximum  likelihood  estimates  for  the  parameters. 
Seven  iterations  wore  required  to  obtain  three-place  precision.   The 
initial  and  final  estimates  of  the  parameters  as  well  as  the  true 
values  used  in  generating  the  data  are  given  in  Table  5.5.2. 

TABLE  5. 5. 2 
MAXIi\IUM  LIKELIHOOD  ESTIMATES 


Initial 
Values 


Final 
Values 


True 
Values 


1.336  0.089  0.163  0.212  0.250  0,285 
1,478  0.094  0,155  0,204  0.249  0.29S 
1.500      0,067      0.133      0,200      0,267      0,333 


We  have  noted  in  estimating  0,  v    ,    tt  ,...,n  ,  using  different  sets  of 
generated  data,  that  accuracy  on  the  extreme  values  of  the  n^  is 
sacrificed  for  accuracy  on  the  intermediate  values,  using  the  iterative 
procedure. 

In  addition  to  examining  the  final  estimates  of  6,  "j  .  •  •  •  .''"'^ 
and  TT^,  it  might  also  be  instructive  to  compare  the  true  cell  probabil- 
ities with  the  estimated  cell  probabilities  found   using  the  maximum 
likelihood  solutions  given  in  Table  5.5,2.   Table  5.5.3  gives  the  true 
and  eslimated  cell  probabilities  for  the  triples(l , 4, 5)  and  (2,3,4); 
the  first  triple  involves  the  three  values  of  p^  (i  =  l.-^.S)  with  the 
largest  error  in  estimation,  while  the  second  iiwolves  the  three  values 
of  p.  (i  =  2,3,4)  with  the  least  error  in  estimation. 

In  referring  to  Table  5.5.3,  we  find  that  for  the  triple  (2,3,4) 
the  lai-gest  deviation  of  the  estimated  from  the  actual  cell  probabil- 
ities is  0.03510,  while  for  the  triple  (1,4,5)  the  largest  deviation  of 
the  estimated  from  the  actual  cell  probabilities  is  0.05481.   These 
deviations  reflect  not  only  the  error  in  estimating  n^,...,n^,  but  also 
the  underestimate  of  6. 


TABLE  5.  5.3 


ACTUAL  AND  ESTIMATED  CELL  PROBABILITIES 
FOR  THE  TRIPLES  (1,4,5)  AND  (2,3,4) 


Triple 

(2,3,4) 

Triple 

(1,4,5) 

Cells 

Actual 

Estimated 

Actual 

Estimated 

1 

0.15432 

0.14409 

0.26100 

0.23084 

2 

0.21787 

0.18277 

0.34108 

0.28627 

3 

0.13407 

0.13216 

0.06700 

0.09113 

4 

0.05866 

0.07  543 

0,01025 

0.02358 

5 

0.06752 

0.08224 

0.03992 

0.05972 

6 

0.04155 

0.05947 

0,00784 

0.01901 

7 

0.02597 

0,03313 

0.00713 

0.01443 

8 

0.04190 

0.04647 

0.00985 

0.01903 

9 

0.09078 

0.07718 

0.14830 

0.12237 

10 

0.02444 

0.03186 

0.00446 

0.01008 

11 

0.04823 

0.05066 

0.03838 

0.04819 

12 

0.0S380 

0.07362 

0.06091 

0.06918 

13 

0.01091 

0.01093 

0.00389 

0.00617 

2  4 

Test  1,  was  performed  with  a  resulting  value  of  X  =  1.4315  x  10   with 

four  degrees  of  freedom,  a  highly  significant  value.   Also,  a  test  of 


2  2 

highly   significant   valvie   of   x     =    2.3041    x   10      based   on  one   degree   of 

freedom. 

A  large  sample  approximation  to  the  dispersion  matrix  of 
(6,  P-,  ,  P„,...,P  )  was  calculated  bj'  replacing  the  parameters 
0,  n  ,  n  ,...,TT  with  their  maximum  likelihood  estimates  in  (1/50)E, 
wliere  Z  is  defined  in  (5.1.16).   These  variances  and  covariances  can 
be  used  for  calculating  approximate  asymptotic  confidence  bounds  for 
the  parameters  of  tlie  model. 
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